Max level shown:
1 [ Nov 9 02:46:17 Enabled. ]
2 [ Nov 9 02:46:17 Rereading configuration. ]
3 [ Nov 9 02:46:19 Rereading configuration. ]
4 [ Nov 9 02:46:31 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Nov 9 02:46:31 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-11-09T02:46:31.257ZDEBGnexus: registered DTrace probes
82024-11-09T02:46:31.260ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:74
92024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-11-09T02:46:31.267ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-11-09T02:46:31.268ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-11-09T02:46:31.268ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-11-09T02:46:31.284ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-11-09T02:46:31.286ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-11-09T02:46:31.291ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-11-09T02:46:31.299ZDEBGnexus (ServerContext): registered USDT probes
672024-11-09T02:46:31.319ZINFOnexus: Database schema version is up to date desired_version = 113.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 113.0.0
682024-11-09T02:46:31.322ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
692024-11-09T02:46:31.328ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 670033254 } })
702024-11-09T02:46:31.328ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
712024-11-09T02:46:31.377ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
722024-11-09T02:46:31.377ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-11-09T02:46:31.380ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "08d48646-51bf-4c0f-9b37-af903b511556", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:31 GMT"} })
742024-11-09T02:46:31.380ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-11-09T02:46:31.380ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-11-09T02:46:31.411ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 894, tv_nsec: 752958127 } })
772024-11-09T02:46:31.411ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1114
782024-11-09T02:46:31.443ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
792024-11-09T02:46:31.443ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-11-09T02:46:31.443ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "433d9eda-650f-45d4-9424-a2fa8ca9c419", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:31 GMT"} })
812024-11-09T02:46:31.443ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-11-09T02:46:31.444ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-11-09T02:46:31.511ZDEBGnexus (clickhouse-client): registered USDT probes id = 5fda6d5c-5fdc-4001-849a-385c4c7d0fe4
842024-11-09T02:46:31.511ZDEBGnexus (clickhouse-client): registered USDT probes id = 5fda6d5c-5fdc-4001-849a-385c4c7d0fe4
852024-11-09T02:46:31.527ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
862024-11-09T02:46:31.537ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
872024-11-09T02:46:31.538ZDEBGnexus (DataLoader): attempting to create built-in users
882024-11-09T02:46:31.539ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
892024-11-09T02:46:31.539ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
902024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version}
912024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks
922024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate
932024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name}
942024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy
952024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy
962024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request
972024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped
982024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress
992024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish
1002024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start
1012024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga
1022024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete
1032024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all
1042024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id}
1052024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id}
1062024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import
1072024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate
1082024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target
1092024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target
1102024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled
1112024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent
1122024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id}
1132024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate
1142024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors
1152024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers
1162024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers
1172024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen}
1182024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge
1192024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled}
1202024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete
1212024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas
1222024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id}
1232024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id}
1242024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}
1252024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update
1262024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add
1272024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge
1282024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized
1292024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id}
1302024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id}
1312024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent
1322024-11-09T02:46:31.554ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:12221
1332024-11-09T02:46:31.554ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1342024-11-09T02:46:31.554ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1352024-11-09T02:46:31.555ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1362024-11-09T02:46:31.623ZWARNnexus: Cannot look up rack: Object (of type ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29)) not found: rack file = nexus/src/app/rack.rs:774
1372024-11-09T02:46:31.646ZINFOnexus (DataLoader): created 0 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1382024-11-09T02:46:31.646ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1392024-11-09T02:46:31.648ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1402024-11-09T02:46:31.650ZDEBGnexus (DataLoader): attempting to create built-in roles
1412024-11-09T02:46:31.650ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1422024-11-09T02:46:31.650ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1432024-11-09T02:46:31.659ZINFOnexus (DataLoader): created 0 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1442024-11-09T02:46:31.659ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1452024-11-09T02:46:31.661ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1462024-11-09T02:46:31.661ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1472024-11-09T02:46:31.661ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1482024-11-09T02:46:31.661ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1492024-11-09T02:46:31.727ZINFOnexus (DataLoader): created 0 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1502024-11-09T02:46:31.727ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1512024-11-09T02:46:31.730ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1522024-11-09T02:46:31.730ZDEBGnexus (DataLoader): attempting to create built-in silos
1532024-11-09T02:46:31.730ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1542024-11-09T02:46:31.730ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1552024-11-09T02:46:31.799ZINFOnexus (DataLoader): created 0 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:95
1562024-11-09T02:46:31.799ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1572024-11-09T02:46:31.800ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1582024-11-09T02:46:31.823ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1592024-11-09T02:46:31.825ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1602024-11-09T02:46:31.825ZDEBGnexus (DataLoader): attempting to create built-in projects
1612024-11-09T02:46:31.825ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1622024-11-09T02:46:31.825ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1632024-11-09T02:46:31.841ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-11-09T02:46:31.842ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-11-09T02:46:31.844ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-11-09T02:46:31.844ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-11-09T02:46:31.906ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1682024-11-09T02:46:31.908ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1692024-11-09T02:46:31.908ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1702024-11-09T02:46:31.908ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1712024-11-09T02:46:31.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1722024-11-09T02:46:31.967ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1732024-11-09T02:46:31.969ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1742024-11-09T02:46:31.972ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1752024-11-09T02:46:31.972ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1762024-11-09T02:46:31.972ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1772024-11-09T02:46:32.089ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1782024-11-09T02:46:32.089ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1792024-11-09T02:46:32.090ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1802024-11-09T02:46:32.090ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1812024-11-09T02:46:32.090ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-11-09T02:46:32.090ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-11-09T02:46:32.095ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-11-09T02:46:32.096ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-11-09T02:46:32.098ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-11-09T02:46:32.098ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1872024-11-09T02:46:32.100ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-11-09T02:46:32.101ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-11-09T02:46:32.142ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1902024-11-09T02:46:32.143ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1912024-11-09T02:46:32.226ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1922024-11-09T02:46:32.229ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
1932024-11-09T02:46:32.229ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-11-09T02:46:32.229ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-11-09T02:46:32.231ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-11-09T02:46:32.231ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-11-09T02:46:32.233ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-11-09T02:46:32.233ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-11-09T02:46:32.235ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-11-09T02:46:32.237ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2012024-11-09T02:46:32.237ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-11-09T02:46:32.237ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-11-09T02:46:32.337ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-11-09T02:46:32.338ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2052024-11-09T02:46:32.340ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-11-09T02:46:32.341ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-11-09T02:46:32.343ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-11-09T02:46:32.343ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-11-09T02:46:32.345ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-11-09T02:46:32.348ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2112024-11-09T02:46:32.348ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-11-09T02:46:32.348ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2132024-11-09T02:46:32.382ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-11-09T02:46:32.383ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-11-09T02:46:32.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-11-09T02:46:32.394ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-11-09T02:46:32.396ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-11-09T02:46:32.396ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-11-09T02:46:32.397ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-11-09T02:46:32.398ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-11-09T02:46:32.399ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-11-09T02:46:32.400ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2232024-11-09T02:46:32.401ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-11-09T02:46:32.401ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-11-09T02:46:32.402ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-11-09T02:46:32.402ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-11-09T02:46:32.404ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-11-09T02:46:32.408ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2292024-11-09T02:46:32.408ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-11-09T02:46:32.408ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-11-09T02:46:32.409ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-11-09T02:46:32.410ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-11-09T02:46:32.411ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-11-09T02:46:32.411ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-11-09T02:46:32.412ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-11-09T02:46:32.416ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2372024-11-09T02:46:32.416ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-11-09T02:46:32.416ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-11-09T02:46:32.456ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-11-09T02:46:32.457ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-11-09T02:46:32.458ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-11-09T02:46:32.459ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-11-09T02:46:32.460ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-11-09T02:46:32.460ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-11-09T02:46:32.476ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-11-09T02:46:32.479ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2472024-11-09T02:46:32.479ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-11-09T02:46:32.480ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-11-09T02:46:32.561ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2502024-11-09T02:46:32.562ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2512024-11-09T02:46:32.562ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2522024-11-09T02:46:32.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2532024-11-09T02:46:32.564ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2542024-11-09T02:46:32.565ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2552024-11-09T02:46:32.566ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2562024-11-09T02:46:32.568ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2572024-11-09T02:46:32.568ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2582024-11-09T02:46:32.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2592024-11-09T02:46:32.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2602024-11-09T02:46:32.570ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2612024-11-09T02:46:32.570ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2622024-11-09T02:46:32.571ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2632024-11-09T02:46:32.576ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2642024-11-09T02:46:32.576ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2652024-11-09T02:46:32.576ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2662024-11-09T02:46:32.577ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2672024-11-09T02:46:32.577ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2682024-11-09T02:46:32.578ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2692024-11-09T02:46:32.579ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2702024-11-09T02:46:32.580ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2712024-11-09T02:46:32.583ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2722024-11-09T02:46:32.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2732024-11-09T02:46:32.583ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2742024-11-09T02:46:32.591ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2752024-11-09T02:46:32.592ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2762024-11-09T02:46:32.593ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2772024-11-09T02:46:32.593ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2782024-11-09T02:46:32.595ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2792024-11-09T02:46:32.595ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2802024-11-09T02:46:32.596ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2812024-11-09T02:46:32.599ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2822024-11-09T02:46:32.599ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2832024-11-09T02:46:32.599ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2842024-11-09T02:46:32.746ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2852024-11-09T02:46:32.746ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2862024-11-09T02:46:32.746ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2872024-11-09T02:46:32.746ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2882024-11-09T02:46:32.756ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2892024-11-09T02:46:32.756ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2902024-11-09T02:46:32.758ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2912024-11-09T02:46:32.758ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2922024-11-09T02:46:32.761ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2932024-11-09T02:46:32.761ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2942024-11-09T02:46:32.762ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2952024-11-09T02:46:32.762ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2962024-11-09T02:46:32.763ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2972024-11-09T02:46:32.764ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2982024-11-09T02:46:32.765ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2992024-11-09T02:46:32.768ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3002024-11-09T02:46:32.768ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3012024-11-09T02:46:32.768ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3022024-11-09T02:46:32.771ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3032024-11-09T02:46:32.771ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3042024-11-09T02:46:32.772ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3052024-11-09T02:46:32.773ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3062024-11-09T02:46:32.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3072024-11-09T02:46:32.774ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3082024-11-09T02:46:32.775ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3092024-11-09T02:46:32.776ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3102024-11-09T02:46:32.777ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3112024-11-09T02:46:32.777ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3122024-11-09T02:46:32.778ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3132024-11-09T02:46:32.778ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3142024-11-09T02:46:32.780ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3152024-11-09T02:46:32.784ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ById(001de000-c470-4000-8000-000000000001) } result = Ok(())
3162024-11-09T02:46:32.784ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3172024-11-09T02:46:32.784ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3182024-11-09T02:46:32.789ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3192024-11-09T02:46:32.789ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3202024-11-09T02:46:32.798ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3212024-11-09T02:46:32.798ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3222024-11-09T02:46:32.811ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3232024-11-09T02:46:32.811ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3242024-11-09T02:46:32.813ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3252024-11-09T02:46:32.814ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3262024-11-09T02:46:32.829ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3272024-11-09T02:46:32.829ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3282024-11-09T02:46:32.830ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3292024-11-09T02:46:32.831ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3302024-11-09T02:46:32.832ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3312024-11-09T02:46:32.836ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ById(001de000-c470-4000-8000-000000000002) } result = Ok(())
3322024-11-09T02:46:32.836ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3332024-11-09T02:46:32.836ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3342024-11-09T02:46:32.846ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-11-09T02:46:32.846ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-11-09T02:46:32.848ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-11-09T02:46:32.848ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-11-09T02:46:32.849ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-11-09T02:46:32.849ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-11-09T02:46:32.851ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-11-09T02:46:32.853ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3422024-11-09T02:46:32.891ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-11-09T02:46:32.891ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3442024-11-09T02:46:32.917ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-11-09T02:46:32.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-11-09T02:46:32.923ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-11-09T02:46:32.923ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-11-09T02:46:32.924ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-11-09T02:46:32.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-11-09T02:46:32.926ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-11-09T02:46:32.926ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-11-09T02:46:32.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-11-09T02:46:32.931ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3542024-11-09T02:46:32.931ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-11-09T02:46:32.931ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3562024-11-09T02:46:32.942ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3572024-11-09T02:46:32.942ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3582024-11-09T02:46:32.942ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-11-09T02:46:32.943ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602024-11-09T02:46:32.943ZDEBGnexus (DataLoader): attempting to create silo users
3612024-11-09T02:46:32.943ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3622024-11-09T02:46:32.943ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3632024-11-09T02:46:32.950ZINFOnexus (DataLoader): created 0 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
3642024-11-09T02:46:32.950ZDEBGnexus (DataLoader): attempting to create silo user role assignments
3652024-11-09T02:46:32.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3662024-11-09T02:46:32.951ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3672024-11-09T02:46:32.953ZINFOnexus (DataLoader): created 0 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
3682024-11-09T02:46:32.953ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-11-09T02:46:32.953ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-11-09T02:46:32.955ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-11-09T02:46:32.955ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-11-09T02:46:32.991ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-11-09T02:46:32.992ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742024-11-09T02:46:32.993ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-11-09T02:46:32.994ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
3762024-11-09T02:46:32.994ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-11-09T02:46:32.994ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-11-09T02:46:33.005ZINFOnexus: populate complete file = nexus/src/app/mod.rs:538
3792024-11-09T02:46:33.005ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:547
3802024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
3812024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
3822024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
3832024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
3842024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
3852024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
3862024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
3872024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
3882024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
3892024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
3902024-11-09T02:46:33.007ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
3912024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
3922024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
3932024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
3942024-11-09T02:46:33.008ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
3952024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
3962024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
3972024-11-09T02:46:33.008ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
3982024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
3992024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4002024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4012024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4022024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4032024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4042024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4052024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4062024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4072024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4082024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4092024-11-09T02:46:33.008ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4102024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4112024-11-09T02:46:33.008ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:36:33.008129568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4122024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4132024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
4142024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4152024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4162024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4172024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4182024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4192024-11-09T02:46:33.008ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4202024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4212024-11-09T02:46:33.008ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4222024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4232024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4242024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4252024-11-09T02:46:33.008ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4262024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4272024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4282024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 932.499\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4292024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 753.586\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4302024-11-09T02:46:33.008ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 999.371\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4312024-11-09T02:46:33.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4322024-11-09T02:46:33.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4332024-11-09T02:46:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4342024-11-09T02:46:33.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4352024-11-09T02:46:33.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
4362024-11-09T02:46:33.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
4372024-11-09T02:46:33.010ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4382024-11-09T02:46:33.010ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4392024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4402024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
4412024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4422024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4432024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
4442024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.236368ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
4452024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
4462024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4472024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.678646ms iteration = 1 status = {"error":"no config nor servers"}
4482024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
4492024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
4502024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4512024-11-09T02:46:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.33956ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
4522024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.289038ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
4532024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4542024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4552024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
4562024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4572024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
4582024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4592024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
4602024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.509023ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
4612024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
4622024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
4632024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
4642024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
4652024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
4662024-11-09T02:46:33.013ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
4672024-11-09T02:46:33.013ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
4682024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
4692024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
4702024-11-09T02:46:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
4712024-11-09T02:46:33.014ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 355591577 } })
4722024-11-09T02:46:33.015ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 356769031 } })
4732024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
4742024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
4752024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
4762024-11-09T02:46:33.015ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
4772024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
4782024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4792024-11-09T02:46:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4802024-11-09T02:46:33.016ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
4812024-11-09T02:46:33.016ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
4822024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 8.156098ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
4832024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 7.985295ms iteration = 1 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
4842024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
4852024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
4862024-11-09T02:46:33.016ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4872024-11-09T02:46:33.016ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
4882024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 3.09\u{b5}s iteration = 2 status = {"error":"no config"}
4892024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 3.961\u{b5}s iteration = 2 status = {"error":"no config"}
4902024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
4912024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
4922024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
4932024-11-09T02:46:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
4942024-11-09T02:46:33.017ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 9.66582ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
4952024-11-09T02:46:33.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 361803045 } })
4962024-11-09T02:46:33.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
4972024-11-09T02:46:33.022ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
4982024-11-09T02:46:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
4992024-11-09T02:46:33.024ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5002024-11-09T02:46:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5012024-11-09T02:46:33.027ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5022024-11-09T02:46:33.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5032024-11-09T02:46:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5042024-11-09T02:46:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5052024-11-09T02:46:33.039ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:36:33.008129568 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5062024-11-09T02:46:33.039ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 31.678515ms iteration = 1 status = {"expiration":"2024-11-09T02:36:33.008129568Z","pruned":[]}
5072024-11-09T02:46:33.059ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 401444395 } })
5082024-11-09T02:46:33.060ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
5092024-11-09T02:46:33.061ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 53.100207ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5102024-11-09T02:46:33.064ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5112024-11-09T02:46:33.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5122024-11-09T02:46:33.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5132024-11-09T02:46:33.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5142024-11-09T02:46:33.072ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5152024-11-09T02:46:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5162024-11-09T02:46:33.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5172024-11-09T02:46:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5182024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5192024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
5202024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5212024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5222024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5232024-11-09T02:46:33.075ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5242024-11-09T02:46:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5252024-11-09T02:46:33.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5262024-11-09T02:46:33.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5272024-11-09T02:46:33.078ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
5282024-11-09T02:46:33.078ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5292024-11-09T02:46:33.078ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5302024-11-09T02:46:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5312024-11-09T02:46:33.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5322024-11-09T02:46:33.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5332024-11-09T02:46:33.080ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7bffd74-809e-4498-aa58-adf6351b29ea", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
5342024-11-09T02:46:33.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5352024-11-09T02:46:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
5362024-11-09T02:46:33.082ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
5372024-11-09T02:46:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5382024-11-09T02:46:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
5392024-11-09T02:46:33.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
5402024-11-09T02:46:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5412024-11-09T02:46:33.084ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5422024-11-09T02:46:33.085ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5432024-11-09T02:46:33.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5442024-11-09T02:46:33.086ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5452024-11-09T02:46:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
5462024-11-09T02:46:33.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5472024-11-09T02:46:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5482024-11-09T02:46:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5492024-11-09T02:46:33.089ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 81.092686ms iteration = 1 status = {}
5502024-11-09T02:46:33.090ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5512024-11-09T02:46:33.090ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
5522024-11-09T02:46:33.090ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 82.464754ms iteration = 1 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
5532024-11-09T02:46:33.092ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5542024-11-09T02:46:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5552024-11-09T02:46:33.094ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5562024-11-09T02:46:33.094ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5572024-11-09T02:46:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5582024-11-09T02:46:33.095ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5592024-11-09T02:46:33.095ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5602024-11-09T02:46:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5612024-11-09T02:46:33.096ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
5622024-11-09T02:46:33.096ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 88.009589ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
5632024-11-09T02:46:33.098ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5642024-11-09T02:46:33.098ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5652024-11-09T02:46:33.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5662024-11-09T02:46:33.100ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5682024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5692024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
5702024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5712024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5722024-11-09T02:46:33.104ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
5732024-11-09T02:46:33.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.890843ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
5742024-11-09T02:46:33.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5752024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
5762024-11-09T02:46:33.106ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
5772024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 97.921633ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
5782024-11-09T02:46:33.106ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5792024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5802024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5812024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5822024-11-09T02:46:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5832024-11-09T02:46:33.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5842024-11-09T02:46:33.108ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5852024-11-09T02:46:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
5862024-11-09T02:46:33.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5872024-11-09T02:46:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5882024-11-09T02:46:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5892024-11-09T02:46:33.109ZWARNnexus (BackgroundTasks): inventory collection is None background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:95
5902024-11-09T02:46:33.109ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 101.584029ms iteration = 1 status = {"error":"inventory collection is None"}
5912024-11-09T02:46:33.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5922024-11-09T02:46:33.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5932024-11-09T02:46:33.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5942024-11-09T02:46:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5952024-11-09T02:46:33.119ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
5962024-11-09T02:46:33.119ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5972024-11-09T02:46:33.119ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f934a8d3-ec05-428d-b10e-352d2c696e10", "content-length": "26", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
5982024-11-09T02:46:33.119ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5992024-11-09T02:46:33.121ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6002024-11-09T02:46:33.122ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6012024-11-09T02:46:33.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6022024-11-09T02:46:33.129ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
6032024-11-09T02:46:33.129ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
6042024-11-09T02:46:33.129ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 120.409818ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
6052024-11-09T02:46:33.129ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = []
6062024-11-09T02:46:33.130ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 896, tv_nsec: 471682056 } })
6072024-11-09T02:46:33.143ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6082024-11-09T02:46:33.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6092024-11-09T02:46:33.173ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6102024-11-09T02:46:33.173ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 165.667083ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6112024-11-09T02:46:33.185ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 177.09449ms iteration = 1 status = {}
6122024-11-09T02:46:33.189ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6132024-11-09T02:46:33.192ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 184.871311ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6142024-11-09T02:46:33.193ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
6152024-11-09T02:46:33.193ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 185.030864ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
6162024-11-09T02:46:33.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6172024-11-09T02:46:33.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182024-11-09T02:46:33.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6192024-11-09T02:46:33.201ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6202024-11-09T02:46:33.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6212024-11-09T02:46:33.204ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6222024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 196.551702ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6232024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6242024-11-09T02:46:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 196.908009ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
6252024-11-09T02:46:33.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6262024-11-09T02:46:33.205ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6272024-11-09T02:46:33.205ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 197.674245ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6282024-11-09T02:46:33.208ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6292024-11-09T02:46:33.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6302024-11-09T02:46:33.212ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
6312024-11-09T02:46:33.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6322024-11-09T02:46:33.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6332024-11-09T02:46:33.213ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6342024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6352024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6362024-11-09T02:46:33.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6372024-11-09T02:46:33.218ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
6382024-11-09T02:46:33.218ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
6392024-11-09T02:46:33.218ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
6402024-11-09T02:46:33.218ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6dd61666-028a-44e6-940a-7e8ad78e8040", "content-length": "1", "date": "Sat, 09 Nov 2024 02:46:32 GMT"} })
6412024-11-09T02:46:33.220ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "736994c6-28ab-44c5-8968-302fc60fa414", "content-length": "476", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6422024-11-09T02:46:33.220ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
6432024-11-09T02:46:33.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
6442024-11-09T02:46:33.220ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6452024-11-09T02:46:33.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6462024-11-09T02:46:33.223ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6472024-11-09T02:46:33.223ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6482024-11-09T02:46:33.227ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
6492024-11-09T02:46:33.227ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a73d8a58-8c88-4b87-b4d9-7f30c5c335af", "content-length": "734", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6502024-11-09T02:46:33.231ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
6512024-11-09T02:46:33.233ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "30b354fa-8adb-4294-bc37-cee0d1bae70d", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6522024-11-09T02:46:33.233ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
6532024-11-09T02:46:33.234ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6b99ff7-573a-420a-b70a-a87df121ffd2", "content-length": "111", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6542024-11-09T02:46:33.234ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
6552024-11-09T02:46:33.234ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8aff1b5b-1650-4484-9c79-179bbfe02bdb", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6562024-11-09T02:46:33.234ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
6572024-11-09T02:46:33.235ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a370178-58c5-4702-9183-339e06b127b7", "content-length": "167", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6582024-11-09T02:46:33.235ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
6592024-11-09T02:46:33.235ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b334b6de-97dc-4aa5-b5a6-599fdc16faaa", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6602024-11-09T02:46:33.235ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
6612024-11-09T02:46:33.236ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "510e4a59-75c8-4f02-8fcb-9a50ee0861cd", "content-length": "175", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6622024-11-09T02:46:33.236ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
6632024-11-09T02:46:33.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6642024-11-09T02:46:33.240ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fa386b2-a6b2-43ea-a372-be3e2c2101b7", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6652024-11-09T02:46:33.240ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6662024-11-09T02:46:33.243ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6672024-11-09T02:46:33.245ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "91de302f-7fbf-4a11-8ad3-a5efeaf25e4a", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6682024-11-09T02:46:33.245ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6692024-11-09T02:46:33.245ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0713e16e-4a31-4cc7-96c1-577ebd439243", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6702024-11-09T02:46:33.245ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
6712024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9fb8c90b-ca43-451c-b2fc-9ffb772296e5", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6722024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
6732024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6742024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 237.941667ms iteration = 1 status = null
6752024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f7a902d-3d25-4ae8-9db4-2f4b98acd364", "content-length": "722", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6762024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6772024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
6782024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eeece427-6eaa-4e66-bf57-9a81b429a57a", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6792024-11-09T02:46:33.246ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
6802024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ed950e6d-519f-41ff-9f94-205a47f27d02", "content-length": "109", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6812024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
6822024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "11dc2b8d-5259-420f-b41e-82f926d14de4", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6832024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
6842024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "696d80a9-1710-470f-9865-994868f80b77", "content-length": "169", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6852024-11-09T02:46:33.247ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
6862024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "68a62d74-29da-4ba9-8fda-df9ae366746e", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6872024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
6882024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8ae5632b-9183-42c9-b76f-a39b4eca3d23", "content-length": "178", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6892024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
6902024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d8ed416-8832-4bd7-81a0-6e55afcac334", "content-length": "702", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6912024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6922024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e8e37b0-58d6-44e1-9904-d36351a80102", "content-length": "727", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6932024-11-09T02:46:33.248ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6942024-11-09T02:46:33.249ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f78d992-439e-4004-a9ef-9f6de5ca237a", "content-length": "729", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6952024-11-09T02:46:33.249ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
6962024-11-09T02:46:33.252ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 244.33152ms iteration = 1 status = {}
6972024-11-09T02:46:33.252ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "12fed515-ce50-4140-98cc-b2f904757c52", "content-length": "728", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} })
6982024-11-09T02:46:33.252ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
6992024-11-09T02:46:33.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7002024-11-09T02:46:33.256ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7012024-11-09T02:46:33.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7022024-11-09T02:46:33.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7032024-11-09T02:46:33.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7042024-11-09T02:46:33.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7052024-11-09T02:46:33.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7062024-11-09T02:46:33.284ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7072024-11-09T02:46:33.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082024-11-09T02:46:33.293ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7092024-11-09T02:46:33.293ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7102024-11-09T02:46:33.294ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 286.093413ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7112024-11-09T02:46:33.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7122024-11-09T02:46:33.311ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7132024-11-09T02:46:33.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7142024-11-09T02:46:33.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7152024-11-09T02:46:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7162024-11-09T02:46:33.329ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7172024-11-09T02:46:33.329ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7182024-11-09T02:46:33.329ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 321.342971ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7192024-11-09T02:46:33.334ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7202024-11-09T02:46:33.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7212024-11-09T02:46:33.336ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7222024-11-09T02:46:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7232024-11-09T02:46:33.338ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7242024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
7252024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7262024-11-09T02:46:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7272024-11-09T02:46:33.370ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7282024-11-09T02:46:33.377ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7292024-11-09T02:46:33.377ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7302024-11-09T02:46:33.377ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7312024-11-09T02:46:33.379ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7322024-11-09T02:46:33.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7332024-11-09T02:46:33.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7342024-11-09T02:46:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7352024-11-09T02:46:33.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7362024-11-09T02:46:33.387ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7372024-11-09T02:46:33.387ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-11-09T02:46:33.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-11-09T02:46:33.409ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-11-09T02:46:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-11-09T02:46:33.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422024-11-09T02:46:33.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7432024-11-09T02:46:33.414ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7442024-11-09T02:46:33.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7452024-11-09T02:46:33.416ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7462024-11-09T02:46:33.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7472024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7482024-11-09T02:46:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7492024-11-09T02:46:33.425ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7502024-11-09T02:46:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7512024-11-09T02:46:33.427ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
7522024-11-09T02:46:33.429ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7532024-11-09T02:46:33.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7542024-11-09T02:46:33.431ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7552024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
7562024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
7572024-11-09T02:46:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
7582024-11-09T02:46:33.455ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7592024-11-09T02:46:33.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7602024-11-09T02:46:33.457ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7612024-11-09T02:46:33.461ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7622024-11-09T02:46:33.461ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7632024-11-09T02:46:33.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7642024-11-09T02:46:33.464ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7652024-11-09T02:46:33.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7662024-11-09T02:46:33.465ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7672024-11-09T02:46:33.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7682024-11-09T02:46:33.467ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7692024-11-09T02:46:33.473ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7702024-11-09T02:46:33.473ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7712024-11-09T02:46:33.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7722024-11-09T02:46:33.482ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
7732024-11-09T02:46:33.483ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7742024-11-09T02:46:33.484ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7752024-11-09T02:46:33.485ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7762024-11-09T02:46:33.487ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7772024-11-09T02:46:33.487ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7782024-11-09T02:46:33.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7792024-11-09T02:46:33.498ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7802024-11-09T02:46:33.498ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7812024-11-09T02:46:33.498ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7822024-11-09T02:46:33.515ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7832024-11-09T02:46:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7842024-11-09T02:46:33.517ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7862024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7872024-11-09T02:46:33.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7882024-11-09T02:46:33.520ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7892024-11-09T02:46:33.522ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
7902024-11-09T02:46:33.523ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7912024-11-09T02:46:33.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7922024-11-09T02:46:33.581ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 573.154424ms iteration = 1 status = {}
7932024-11-09T02:46:33.624ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7942024-11-09T02:46:33.624ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7952024-11-09T02:46:33.626ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
7962024-11-09T02:46:33.626ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
7972024-11-09T02:46:33.628ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7982024-11-09T02:46:33.632ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
7992024-11-09T02:46:33.632ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: None } file = nexus/src/app/rack.rs:768
8002024-11-09T02:46:33.663ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8012024-11-09T02:46:33.663ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8022024-11-09T02:46:33.663ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8032024-11-09T02:46:33.663ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 652.787421ms
8042024-11-09T02:46:33.663ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 655.137359ms iteration = 1 status = {}
8052024-11-09T02:46:33.678ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = babcbb52-0146-4325-bd58-0bf30cabbe14 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
8062024-11-09T02:46:33.678ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = babcbb52-0146-4325-bd58-0bf30cabbe14 time_started = 2024-11-09 02:46:33.217765 UTC
8072024-11-09T02:46:33.678ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 670.650879ms iteration = 1 status = {"collection_id":"babcbb52-0146-4325-bd58-0bf30cabbe14","time_done":"2024-11-09 02:46:33.427988 UTC","time_started":"2024-11-09 02:46:33.217765 UTC"}
8082024-11-09T02:46:33.678ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8092024-11-09T02:46:33.678ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8102024-11-09T02:46:33.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8112024-11-09T02:46:33.680ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8122024-11-09T02:46:33.682ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
8132024-11-09T02:46:33.682ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8142024-11-09T02:46:33.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8152024-11-09T02:46:33.684ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
8162024-11-09T02:46:33.684ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.275419ms iteration = 2 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
8172024-11-09T02:46:33.782ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64381
8182024-11-09T02:46:33.795ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8192024-11-09T02:46:33.796ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8202024-11-09T02:46:33.797ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8212024-11-09T02:46:33.799ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8222024-11-09T02:46:33.799ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8232024-11-09T02:46:33.799ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8242024-11-09T02:46:33.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8252024-11-09T02:46:33.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8262024-11-09T02:46:33.889ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 setting = cluster.preserve_downgrade_option uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete value = 22.1
8272024-11-09T02:46:33.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8282024-11-09T02:46:33.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8292024-11-09T02:46:33.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8302024-11-09T02:46:33.891ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8312024-11-09T02:46:33.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8322024-11-09T02:46:33.895ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8332024-11-09T02:46:33.895ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8342024-11-09T02:46:33.895ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8352024-11-09T02:46:33.895ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8362024-11-09T02:46:33.901ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8372024-11-09T02:46:33.932ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8382024-11-09T02:46:33.932ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "708c2764-51e5-40b4-b8c1-e5f6c2542fc8", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:33 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8392024-11-09T02:46:33.935ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8402024-11-09T02:46:33.935ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8412024-11-09T02:46:33.935ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8422024-11-09T02:46:33.935ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8432024-11-09T02:46:33.960ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8442024-11-09T02:46:33.960ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8452024-11-09T02:46:33.960ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8462024-11-09T02:46:34.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8472024-11-09T02:46:34.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8482024-11-09T02:46:34.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8492024-11-09T02:46:34.135ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8502024-11-09T02:46:34.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8512024-11-09T02:46:34.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8522024-11-09T02:46:34.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8532024-11-09T02:46:34.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8542024-11-09T02:46:34.176ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8552024-11-09T02:46:34.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8562024-11-09T02:46:34.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8572024-11-09T02:46:34.185ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8582024-11-09T02:46:34.186ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8592024-11-09T02:46:34.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8602024-11-09T02:46:34.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8612024-11-09T02:46:34.195ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8622024-11-09T02:46:34.195ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8632024-11-09T02:46:34.196ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8642024-11-09T02:46:34.199ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8652024-11-09T02:46:34.199ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8662024-11-09T02:46:34.199ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8672024-11-09T02:46:34.200ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8682024-11-09T02:46:34.201ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8692024-11-09T02:46:34.202ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8702024-11-09T02:46:34.204ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8712024-11-09T02:46:34.228ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8722024-11-09T02:46:34.228ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8732024-11-09T02:46:34.230ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8742024-11-09T02:46:34.231ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8752024-11-09T02:46:34.394ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8762024-11-09T02:46:34.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8772024-11-09T02:46:34.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8782024-11-09T02:46:34.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8792024-11-09T02:46:34.398ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8802024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8812024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8822024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8832024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8842024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8852024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8862024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8872024-11-09T02:46:34.406ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8882024-11-09T02:46:34.509ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8892024-11-09T02:46:34.531ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8902024-11-09T02:46:34.553ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8912024-11-09T02:46:34.581ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8922024-11-09T02:46:34.612ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8932024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8942024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8952024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8962024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8972024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8982024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
8992024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9002024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9012024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9022024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9032024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9042024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9052024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9062024-11-09T02:46:34.613ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9072024-11-09T02:46:34.645ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9082024-11-09T02:46:34.645ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9092024-11-09T02:46:34.645ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:33.799159364Z, time_modified: 2024-11-09T02:46:33.799159364Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9102024-11-09T02:46:34.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9112024-11-09T02:46:34.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9122024-11-09T02:46:34.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9132024-11-09T02:46:34.649ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9142024-11-09T02:46:34.683ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9152024-11-09T02:46:34.687ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 904876 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 65a5e0ad-7547-4821-90e9-ccb917e4a575 response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9162024-11-09T02:46:35.633ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9172024-11-09T02:46:35.633ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9182024-11-09T02:46:35.635ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9192024-11-09T02:46:35.635ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9202024-11-09T02:46:35.636ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9212024-11-09T02:46:35.639ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
9222024-11-09T02:46:35.639ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9232024-11-09T02:46:37.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9242024-11-09T02:46:37.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9252024-11-09T02:46:37.395ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9262024-11-09T02:46:37.396ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9272024-11-09T02:46:37.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9282024-11-09T02:46:37.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9292024-11-09T02:46:37.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9302024-11-09T02:46:37.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9312024-11-09T02:46:37.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9322024-11-09T02:46:37.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9332024-11-09T02:46:37.419ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9342024-11-09T02:46:37.422ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9352024-11-09T02:46:37.422ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9362024-11-09T02:46:37.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9372024-11-09T02:46:37.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9382024-11-09T02:46:37.426ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9392024-11-09T02:46:37.458ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9402024-11-09T02:46:37.458ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "e475a7e0-12e0-4c01-96fe-1a9e041f4a80", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:36 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9412024-11-09T02:46:37.458ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9422024-11-09T02:46:37.458ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9432024-11-09T02:46:37.458ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9442024-11-09T02:46:37.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9452024-11-09T02:46:37.478ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9462024-11-09T02:46:37.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9472024-11-09T02:46:37.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9482024-11-09T02:46:37.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9492024-11-09T02:46:37.483ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9502024-11-09T02:46:37.488ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9512024-11-09T02:46:37.489ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9522024-11-09T02:46:37.497ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9532024-11-09T02:46:37.498ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9542024-11-09T02:46:37.499ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9552024-11-09T02:46:37.499ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9562024-11-09T02:46:37.503ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9572024-11-09T02:46:37.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9582024-11-09T02:46:37.505ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9592024-11-09T02:46:37.506ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9602024-11-09T02:46:37.508ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9612024-11-09T02:46:37.508ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9622024-11-09T02:46:37.508ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9632024-11-09T02:46:37.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9642024-11-09T02:46:37.516ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9652024-11-09T02:46:37.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9662024-11-09T02:46:37.520ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9672024-11-09T02:46:37.520ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9682024-11-09T02:46:37.520ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9692024-11-09T02:46:37.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9702024-11-09T02:46:37.522ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9712024-11-09T02:46:37.523ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9722024-11-09T02:46:37.525ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9732024-11-09T02:46:37.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9742024-11-09T02:46:37.542ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9752024-11-09T02:46:37.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9762024-11-09T02:46:37.545ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9772024-11-09T02:46:37.639ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9782024-11-09T02:46:37.640ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9792024-11-09T02:46:37.641ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9802024-11-09T02:46:37.641ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9812024-11-09T02:46:37.643ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9822024-11-09T02:46:37.645ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
9832024-11-09T02:46:37.645ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9842024-11-09T02:46:37.653ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9852024-11-09T02:46:37.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9862024-11-09T02:46:37.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9872024-11-09T02:46:37.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9882024-11-09T02:46:37.656ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9892024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9902024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9912024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9922024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9932024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9942024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9952024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9962024-11-09T02:46:37.666ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9972024-11-09T02:46:37.746ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9982024-11-09T02:46:37.767ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
9992024-11-09T02:46:37.791ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10002024-11-09T02:46:37.812ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10012024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10022024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10032024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10042024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10052024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10062024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10072024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10082024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10092024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10102024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10112024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10122024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10132024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10142024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10152024-11-09T02:46:37.838ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10162024-11-09T02:46:37.867ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10172024-11-09T02:46:37.867ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10182024-11-09T02:46:37.867ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:37.396646373Z, time_modified: 2024-11-09T02:46:37.396646373Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10192024-11-09T02:46:37.867ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10202024-11-09T02:46:37.867ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10212024-11-09T02:46:37.869ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10222024-11-09T02:46:37.871ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10232024-11-09T02:46:37.933ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10242024-11-09T02:46:37.937ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 544347 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = e266971c-f31c-4c3b-bf96-4b1b3ff1b70b response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10252024-11-09T02:46:39.647ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10262024-11-09T02:46:39.647ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10272024-11-09T02:46:39.648ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10282024-11-09T02:46:39.649ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10292024-11-09T02:46:39.650ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10302024-11-09T02:46:39.652ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
10312024-11-09T02:46:39.652ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10322024-11-09T02:46:39.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10332024-11-09T02:46:39.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10342024-11-09T02:46:39.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10352024-11-09T02:46:39.709ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10362024-11-09T02:46:39.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10372024-11-09T02:46:39.710ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10382024-11-09T02:46:39.712ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10392024-11-09T02:46:39.712ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10402024-11-09T02:46:39.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10412024-11-09T02:46:39.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10422024-11-09T02:46:39.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10432024-11-09T02:46:39.718ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10442024-11-09T02:46:39.718ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10452024-11-09T02:46:39.718ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10462024-11-09T02:46:39.718ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10472024-11-09T02:46:39.723ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10482024-11-09T02:46:39.752ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10492024-11-09T02:46:39.752ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "db60a765-dad8-4ca3-990a-7791cd6f9eda", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:39 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10502024-11-09T02:46:39.753ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10512024-11-09T02:46:39.753ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10522024-11-09T02:46:39.753ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10532024-11-09T02:46:39.753ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10542024-11-09T02:46:39.764ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10552024-11-09T02:46:39.764ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10562024-11-09T02:46:39.765ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10572024-11-09T02:46:39.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10582024-11-09T02:46:39.777ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10592024-11-09T02:46:39.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10602024-11-09T02:46:39.781ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10612024-11-09T02:46:39.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10622024-11-09T02:46:39.783ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10632024-11-09T02:46:39.790ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10642024-11-09T02:46:39.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10652024-11-09T02:46:39.806ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10662024-11-09T02:46:39.807ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10672024-11-09T02:46:39.807ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10682024-11-09T02:46:39.809ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10692024-11-09T02:46:39.810ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10702024-11-09T02:46:39.810ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10712024-11-09T02:46:39.810ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10722024-11-09T02:46:39.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10732024-11-09T02:46:39.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10742024-11-09T02:46:39.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10752024-11-09T02:46:39.817ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10762024-11-09T02:46:39.817ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10772024-11-09T02:46:39.817ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10782024-11-09T02:46:39.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10792024-11-09T02:46:39.819ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10802024-11-09T02:46:39.820ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10812024-11-09T02:46:39.822ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10822024-11-09T02:46:39.836ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10832024-11-09T02:46:39.837ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10842024-11-09T02:46:39.838ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10852024-11-09T02:46:39.840ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10862024-11-09T02:46:39.950ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10872024-11-09T02:46:39.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10882024-11-09T02:46:39.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10892024-11-09T02:46:39.952ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10902024-11-09T02:46:39.953ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10912024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10922024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10932024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10942024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10952024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10962024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10972024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10982024-11-09T02:46:39.961ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
10992024-11-09T02:46:40.040ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11002024-11-09T02:46:40.061ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11012024-11-09T02:46:40.081ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11022024-11-09T02:46:40.103ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11032024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11042024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11052024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11062024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11072024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11082024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11092024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11102024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11112024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11122024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11132024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11142024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11152024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11162024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11172024-11-09T02:46:40.128ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11182024-11-09T02:46:40.160ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11192024-11-09T02:46:40.160ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11202024-11-09T02:46:40.160ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:39.709911216Z, time_modified: 2024-11-09T02:46:39.709911216Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11212024-11-09T02:46:40.160ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11222024-11-09T02:46:40.161ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11232024-11-09T02:46:40.162ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11242024-11-09T02:46:40.164ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11252024-11-09T02:46:40.179ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11262024-11-09T02:46:40.182ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 475958 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 4011e72b-1028-4e70-8a4d-ad2eced992c7 response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11272024-11-09T02:46:41.653ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11282024-11-09T02:46:41.653ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11292024-11-09T02:46:41.655ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11302024-11-09T02:46:41.655ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11312024-11-09T02:46:41.657ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11322024-11-09T02:46:41.659ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
11332024-11-09T02:46:41.659ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11342024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
11352024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11362024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
11372024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11382024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11392024-11-09T02:46:43.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11402024-11-09T02:46:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11412024-11-09T02:46:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
11422024-11-09T02:46:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
11432024-11-09T02:46:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
11442024-11-09T02:46:43.016ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
11452024-11-09T02:46:43.016ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 8.656188ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
11462024-11-09T02:46:43.035ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
11472024-11-09T02:46:43.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
11482024-11-09T02:46:43.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.033858ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
11492024-11-09T02:46:43.660ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11502024-11-09T02:46:43.661ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11512024-11-09T02:46:43.662ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11522024-11-09T02:46:43.663ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11532024-11-09T02:46:43.664ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11542024-11-09T02:46:43.667ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
11552024-11-09T02:46:43.667ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11562024-11-09T02:46:44.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11572024-11-09T02:46:44.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11582024-11-09T02:46:44.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11592024-11-09T02:46:44.371ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11602024-11-09T02:46:44.371ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11612024-11-09T02:46:44.371ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11622024-11-09T02:46:44.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11632024-11-09T02:46:44.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11642024-11-09T02:46:44.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11652024-11-09T02:46:44.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11662024-11-09T02:46:44.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11672024-11-09T02:46:44.380ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11682024-11-09T02:46:44.380ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11692024-11-09T02:46:44.380ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11702024-11-09T02:46:44.380ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11712024-11-09T02:46:44.386ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11722024-11-09T02:46:44.416ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11732024-11-09T02:46:44.416ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "0388b4bc-80cd-49b8-b58d-3ba6167d3795", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:43 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11742024-11-09T02:46:44.416ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11752024-11-09T02:46:44.416ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11762024-11-09T02:46:44.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11772024-11-09T02:46:44.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11782024-11-09T02:46:44.432ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11792024-11-09T02:46:44.432ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11802024-11-09T02:46:44.432ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11812024-11-09T02:46:44.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11822024-11-09T02:46:44.437ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11832024-11-09T02:46:44.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11842024-11-09T02:46:44.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11852024-11-09T02:46:44.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11862024-11-09T02:46:44.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11872024-11-09T02:46:44.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11882024-11-09T02:46:44.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11892024-11-09T02:46:44.444ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11902024-11-09T02:46:44.446ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11912024-11-09T02:46:44.446ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11922024-11-09T02:46:44.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11932024-11-09T02:46:44.449ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11942024-11-09T02:46:44.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11952024-11-09T02:46:44.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11962024-11-09T02:46:44.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11972024-11-09T02:46:44.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11982024-11-09T02:46:44.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
11992024-11-09T02:46:44.454ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12002024-11-09T02:46:44.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12012024-11-09T02:46:44.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12022024-11-09T02:46:44.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12032024-11-09T02:46:44.456ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12042024-11-09T02:46:44.457ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12052024-11-09T02:46:44.459ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12062024-11-09T02:46:44.465ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12072024-11-09T02:46:44.465ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12082024-11-09T02:46:44.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12092024-11-09T02:46:44.468ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12102024-11-09T02:46:44.478ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12112024-11-09T02:46:44.478ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12122024-11-09T02:46:44.478ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12132024-11-09T02:46:44.479ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12142024-11-09T02:46:44.481ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12152024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12162024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12172024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12182024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12192024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12202024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12212024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12222024-11-09T02:46:44.484ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12232024-11-09T02:46:44.508ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12242024-11-09T02:46:44.529ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12252024-11-09T02:46:44.550ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12262024-11-09T02:46:44.569ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12272024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12282024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12292024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12302024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12312024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12322024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12332024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12342024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12352024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12362024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12372024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12382024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12392024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12402024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12412024-11-09T02:46:44.594ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12422024-11-09T02:46:44.616ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12432024-11-09T02:46:44.616ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12442024-11-09T02:46:44.616ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:44.371330186Z, time_modified: 2024-11-09T02:46:44.371330186Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12452024-11-09T02:46:44.616ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12462024-11-09T02:46:44.616ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12472024-11-09T02:46:44.618ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12482024-11-09T02:46:44.620ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12492024-11-09T02:46:44.623ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12502024-11-09T02:46:44.628ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 261068 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 097e4a2d-d905-40b3-ad4b-ac36190a6280 response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12512024-11-09T02:46:45.668ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12522024-11-09T02:46:45.669ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12532024-11-09T02:46:45.670ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12542024-11-09T02:46:45.670ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12552024-11-09T02:46:45.672ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12562024-11-09T02:46:45.674ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12572024-11-09T02:46:45.674ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12582024-11-09T02:46:46.554ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:44059
12592024-11-09T02:46:46.555ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44059 req_id = c3ead1e9-54ba-42a5-95b7-8bad3c274422 roles = RoleSet { roles: {} } uri = /metrics/producers
12602024-11-09T02:46:46.556ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44059 req_id = c3ead1e9-54ba-42a5-95b7-8bad3c274422 resource = Database result = Ok(()) uri = /metrics/producers
12612024-11-09T02:46:46.604ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
12622024-11-09T02:46:46.604ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48643 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:44059 req_id = c3ead1e9-54ba-42a5-95b7-8bad3c274422 response_code = 201 uri = /metrics/producers
12632024-11-09T02:46:47.675ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12642024-11-09T02:46:47.675ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12652024-11-09T02:46:47.677ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12662024-11-09T02:46:47.677ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12672024-11-09T02:46:47.679ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
12682024-11-09T02:46:47.681ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
12692024-11-09T02:46:47.681ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
12702024-11-09T02:46:48.280ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:33382
12712024-11-09T02:46:48.281ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 38c812ad-4899-435f-8dda-1e0692c79605 roles = RoleSet { roles: {} } uri = /metrics/producers
12722024-11-09T02:46:48.281ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 38c812ad-4899-435f-8dda-1e0692c79605 resource = Database result = Ok(()) uri = /metrics/producers
12732024-11-09T02:46:48.322ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
12742024-11-09T02:46:48.322ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40550 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:33382 req_id = 38c812ad-4899-435f-8dda-1e0692c79605 response_code = 201 uri = /metrics/producers
12752024-11-09T02:46:49.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12762024-11-09T02:46:49.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12772024-11-09T02:46:49.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12782024-11-09T02:46:49.373ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12792024-11-09T02:46:49.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12802024-11-09T02:46:49.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12812024-11-09T02:46:49.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12822024-11-09T02:46:49.382ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12832024-11-09T02:46:49.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12842024-11-09T02:46:49.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12852024-11-09T02:46:49.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12862024-11-09T02:46:49.389ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12872024-11-09T02:46:49.389ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12882024-11-09T02:46:49.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12892024-11-09T02:46:49.389ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12902024-11-09T02:46:49.394ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12912024-11-09T02:46:49.423ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12922024-11-09T02:46:49.423ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe355dc-bc81-49ad-9a4f-be574618777a", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:48 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12932024-11-09T02:46:49.423ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12942024-11-09T02:46:49.423ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12952024-11-09T02:46:49.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12962024-11-09T02:46:49.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12972024-11-09T02:46:49.433ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12982024-11-09T02:46:49.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
12992024-11-09T02:46:49.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13002024-11-09T02:46:49.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13012024-11-09T02:46:49.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13022024-11-09T02:46:49.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13032024-11-09T02:46:49.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13042024-11-09T02:46:49.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13052024-11-09T02:46:49.442ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13062024-11-09T02:46:49.443ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13072024-11-09T02:46:49.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13082024-11-09T02:46:49.446ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13092024-11-09T02:46:49.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13102024-11-09T02:46:49.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13112024-11-09T02:46:49.449ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13122024-11-09T02:46:49.450ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13132024-11-09T02:46:49.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13142024-11-09T02:46:49.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13152024-11-09T02:46:49.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13162024-11-09T02:46:49.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13172024-11-09T02:46:49.456ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13182024-11-09T02:46:49.459ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13192024-11-09T02:46:49.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13202024-11-09T02:46:49.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13212024-11-09T02:46:49.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13222024-11-09T02:46:49.461ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13232024-11-09T02:46:49.462ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13242024-11-09T02:46:49.464ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13252024-11-09T02:46:49.470ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13262024-11-09T02:46:49.470ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13272024-11-09T02:46:49.471ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13282024-11-09T02:46:49.473ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13292024-11-09T02:46:49.483ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13302024-11-09T02:46:49.483ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13312024-11-09T02:46:49.484ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13322024-11-09T02:46:49.485ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13332024-11-09T02:46:49.486ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13342024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13352024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13362024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13372024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13382024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13392024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13402024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13412024-11-09T02:46:49.493ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13422024-11-09T02:46:49.516ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13432024-11-09T02:46:49.545ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13442024-11-09T02:46:49.566ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13452024-11-09T02:46:49.587ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13462024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13472024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13482024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13492024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13502024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13512024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13522024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13532024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13542024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13552024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13562024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13572024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13582024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13592024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13602024-11-09T02:46:49.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13612024-11-09T02:46:49.628ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13622024-11-09T02:46:49.628ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13632024-11-09T02:46:49.628ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:49.373345914Z, time_modified: 2024-11-09T02:46:49.373345914Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13642024-11-09T02:46:49.628ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13652024-11-09T02:46:49.629ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13662024-11-09T02:46:49.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13672024-11-09T02:46:49.632ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13682024-11-09T02:46:49.635ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13692024-11-09T02:46:49.639ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 270562 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 835d7d8a-8db5-4080-a018-96b0cfb9c9dc response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13702024-11-09T02:46:49.683ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13712024-11-09T02:46:49.683ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13722024-11-09T02:46:49.684ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13732024-11-09T02:46:49.685ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13742024-11-09T02:46:49.686ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13752024-11-09T02:46:49.689ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
13762024-11-09T02:46:49.689ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13772024-11-09T02:46:51.690ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13782024-11-09T02:46:51.690ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13792024-11-09T02:46:51.692ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13802024-11-09T02:46:51.692ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13812024-11-09T02:46:51.693ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13822024-11-09T02:46:51.696ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
13832024-11-09T02:46:51.696ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13842024-11-09T02:46:52.211ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:47964
13852024-11-09T02:46:52.212ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47964 req_id = 21dca87c-645c-4d8e-a230-9e9bfd832560 roles = RoleSet { roles: {} } uri = /metrics/producers
13862024-11-09T02:46:52.213ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47964 req_id = 21dca87c-645c-4d8e-a230-9e9bfd832560 resource = Database result = Ok(()) uri = /metrics/producers
13872024-11-09T02:46:52.253ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
13882024-11-09T02:46:52.253ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40895 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47964 req_id = 21dca87c-645c-4d8e-a230-9e9bfd832560 response_code = 201 uri = /metrics/producers
13892024-11-09T02:46:52.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13902024-11-09T02:46:52.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13912024-11-09T02:46:52.437ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13922024-11-09T02:46:52.438ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13932024-11-09T02:46:52.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13942024-11-09T02:46:52.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13952024-11-09T02:46:52.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13962024-11-09T02:46:52.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13972024-11-09T02:46:52.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13982024-11-09T02:46:52.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
13992024-11-09T02:46:52.452ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14002024-11-09T02:46:52.454ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14012024-11-09T02:46:52.454ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14022024-11-09T02:46:52.454ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14032024-11-09T02:46:52.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14042024-11-09T02:46:52.459ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14052024-11-09T02:46:52.490ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14062024-11-09T02:46:52.490ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "aff363d1-99fb-4b53-8a8d-62f5824bbb4e", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:51 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14072024-11-09T02:46:52.490ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14082024-11-09T02:46:52.490ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14092024-11-09T02:46:52.490ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14102024-11-09T02:46:52.490ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14112024-11-09T02:46:52.502ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14122024-11-09T02:46:52.502ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14132024-11-09T02:46:52.502ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14142024-11-09T02:46:52.505ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14152024-11-09T02:46:52.506ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14162024-11-09T02:46:52.511ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14172024-11-09T02:46:52.511ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14182024-11-09T02:46:52.515ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14192024-11-09T02:46:52.515ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14202024-11-09T02:46:52.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14212024-11-09T02:46:52.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14222024-11-09T02:46:52.520ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14232024-11-09T02:46:52.521ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14242024-11-09T02:46:52.521ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14252024-11-09T02:46:52.522ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14262024-11-09T02:46:52.524ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14272024-11-09T02:46:52.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14282024-11-09T02:46:52.524ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14292024-11-09T02:46:52.526ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14302024-11-09T02:46:52.526ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14312024-11-09T02:46:52.528ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14322024-11-09T02:46:52.530ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14332024-11-09T02:46:52.530ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14342024-11-09T02:46:52.530ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14352024-11-09T02:46:52.530ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:58224
14362024-11-09T02:46:52.532ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14372024-11-09T02:46:52.532ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14382024-11-09T02:46:52.534ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14392024-11-09T02:46:52.535ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58224 req_id = 35221f27-4af2-4543-9f94-e721eb1853b4 roles = RoleSet { roles: {} } uri = /metrics/producers
14402024-11-09T02:46:52.535ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58224 req_id = 35221f27-4af2-4543-9f94-e721eb1853b4 resource = Database result = Ok(()) uri = /metrics/producers
14412024-11-09T02:46:52.536ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14422024-11-09T02:46:52.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14432024-11-09T02:46:52.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14442024-11-09T02:46:52.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14452024-11-09T02:46:52.546ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14462024-11-09T02:46:52.561ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14472024-11-09T02:46:52.561ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14482024-11-09T02:46:52.561ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14492024-11-09T02:46:52.563ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14502024-11-09T02:46:52.564ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14512024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14522024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14532024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14542024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14552024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14562024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14572024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14582024-11-09T02:46:52.569ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14592024-11-09T02:46:52.583ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
14602024-11-09T02:46:52.583ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 48607 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:58224 req_id = 35221f27-4af2-4543-9f94-e721eb1853b4 response_code = 201 uri = /metrics/producers
14612024-11-09T02:46:52.593ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14622024-11-09T02:46:52.614ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14632024-11-09T02:46:52.637ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14642024-11-09T02:46:52.662ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14652024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14662024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14672024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14682024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14692024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14702024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14712024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14722024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14732024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14742024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14752024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14762024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14772024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14782024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14792024-11-09T02:46:52.685ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14802024-11-09T02:46:52.707ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14812024-11-09T02:46:52.707ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14822024-11-09T02:46:52.707ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:52.438475496Z, time_modified: 2024-11-09T02:46:52.438475496Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14832024-11-09T02:46:52.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14842024-11-09T02:46:52.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14852024-11-09T02:46:52.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14862024-11-09T02:46:52.711ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14872024-11-09T02:46:52.713ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14882024-11-09T02:46:52.717ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 282532 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 0db9a578-4f6b-4ff8-938e-3e92f919550e response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
14892024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
14902024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
14912024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14922024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
14932024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14942024-11-09T02:46:53.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
14952024-11-09T02:46:53.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
14962024-11-09T02:46:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
14972024-11-09T02:46:53.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
14982024-11-09T02:46:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
14992024-11-09T02:46:53.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
15002024-11-09T02:46:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
15012024-11-09T02:46:53.015ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
15022024-11-09T02:46:53.015ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.359743ms iteration = 3 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
15032024-11-09T02:46:53.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.996842ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
15042024-11-09T02:46:53.698ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15052024-11-09T02:46:53.698ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15062024-11-09T02:46:53.700ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15072024-11-09T02:46:53.700ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15082024-11-09T02:46:53.701ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15092024-11-09T02:46:53.704ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
15102024-11-09T02:46:53.704ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
15112024-11-09T02:46:55.704ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15122024-11-09T02:46:55.705ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15132024-11-09T02:46:55.706ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15142024-11-09T02:46:55.706ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15152024-11-09T02:46:55.708ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15162024-11-09T02:46:55.711ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
15172024-11-09T02:46:55.711ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
15182024-11-09T02:46:57.712ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15192024-11-09T02:46:57.712ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15202024-11-09T02:46:57.713ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
15212024-11-09T02:46:57.713ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
15222024-11-09T02:46:57.715ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
15232024-11-09T02:46:57.717ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
15242024-11-09T02:46:57.717ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
15252024-11-09T02:46:57.724ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36334
15262024-11-09T02:46:57.724ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36334 req_id = 54e5f820-78bb-4d0a-94dc-d12ba4815edc roles = RoleSet { roles: {} } uri = /metrics/producers
15272024-11-09T02:46:57.725ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36334 req_id = 54e5f820-78bb-4d0a-94dc-d12ba4815edc resource = Database result = Ok(()) uri = /metrics/producers
15282024-11-09T02:46:57.733ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
15292024-11-09T02:46:57.733ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8474 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36334 req_id = 54e5f820-78bb-4d0a-94dc-d12ba4815edc response_code = 201 uri = /metrics/producers
15302024-11-09T02:46:57.970ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15312024-11-09T02:46:57.970ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15322024-11-09T02:46:57.972ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15332024-11-09T02:46:57.974ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15342024-11-09T02:46:57.974ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15352024-11-09T02:46:57.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15362024-11-09T02:46:57.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15372024-11-09T02:46:57.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15382024-11-09T02:46:57.978ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15392024-11-09T02:46:57.979ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15402024-11-09T02:46:57.980ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15412024-11-09T02:46:57.983ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15422024-11-09T02:46:57.983ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15432024-11-09T02:46:57.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15442024-11-09T02:46:57.984ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15452024-11-09T02:46:57.989ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15462024-11-09T02:46:58.022ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15472024-11-09T02:46:58.023ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "02f349a9-2dae-450e-8286-1e4fe0b58597", "content-length": "24", "date": "Sat, 09 Nov 2024 02:46:57 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15482024-11-09T02:46:58.023ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15492024-11-09T02:46:58.023ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15502024-11-09T02:46:58.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15512024-11-09T02:46:58.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15522024-11-09T02:46:58.031ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15532024-11-09T02:46:58.031ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15542024-11-09T02:46:58.032ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15552024-11-09T02:46:58.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15562024-11-09T02:46:58.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15572024-11-09T02:46:58.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15582024-11-09T02:46:58.038ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15592024-11-09T02:46:58.040ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15602024-11-09T02:46:58.040ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15612024-11-09T02:46:58.041ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15622024-11-09T02:46:58.042ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15632024-11-09T02:46:58.045ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15642024-11-09T02:46:58.046ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15652024-11-09T02:46:58.046ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15662024-11-09T02:46:58.048ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15672024-11-09T02:46:58.049ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15682024-11-09T02:46:58.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15692024-11-09T02:46:58.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15702024-11-09T02:46:58.050ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15712024-11-09T02:46:58.050ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15722024-11-09T02:46:58.052ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15732024-11-09T02:46:58.054ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15742024-11-09T02:46:58.054ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15752024-11-09T02:46:58.055ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15762024-11-09T02:46:58.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15772024-11-09T02:46:58.056ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15782024-11-09T02:46:58.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15792024-11-09T02:46:58.059ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15802024-11-09T02:46:58.065ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15812024-11-09T02:46:58.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15822024-11-09T02:46:58.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15832024-11-09T02:46:58.071ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15842024-11-09T02:46:58.082ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15852024-11-09T02:46:58.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15862024-11-09T02:46:58.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15872024-11-09T02:46:58.083ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15882024-11-09T02:46:58.085ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15892024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15902024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15912024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15922024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15932024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15942024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15952024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15962024-11-09T02:46:58.088ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15972024-11-09T02:46:58.109ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15982024-11-09T02:46:58.130ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
15992024-11-09T02:46:58.149ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16002024-11-09T02:46:58.173ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16012024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16022024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16032024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16042024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16052024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16062024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16072024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16082024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16092024-11-09T02:46:58.196ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16102024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16112024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16122024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16132024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16142024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16152024-11-09T02:46:58.197ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16162024-11-09T02:46:58.218ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16172024-11-09T02:46:58.218ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16182024-11-09T02:46:58.218ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:46:57.974209666Z, time_modified: 2024-11-09T02:46:57.974209666Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16192024-11-09T02:46:58.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16202024-11-09T02:46:58.218ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16212024-11-09T02:46:58.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16222024-11-09T02:46:58.222ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16232024-11-09T02:46:58.225ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(f032ba4a-ac68-41c0-a068-00d3371df648)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:815 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16242024-11-09T02:46:58.228ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" error_message_internal = not found: sled with id "f032ba4a-ac68-41c0-a068-00d3371df648" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:938 latency_us = 258963 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = 892447f7-5ce1-496f-bd96-471a1ef90722 response_code = 404 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
16252024-11-09T02:46:59.719ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16262024-11-09T02:46:59.719ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16272024-11-09T02:46:59.721ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16282024-11-09T02:46:59.721ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16292024-11-09T02:46:59.723ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16302024-11-09T02:46:59.725ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
16312024-11-09T02:46:59.725ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16322024-11-09T02:47:01.727ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16332024-11-09T02:47:01.727ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16342024-11-09T02:47:01.729ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
16352024-11-09T02:47:01.729ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
16362024-11-09T02:47:01.731ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16372024-11-09T02:47:01.733ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
16382024-11-09T02:47:01.733ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
16392024-11-09T02:47:01.870ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64150
16402024-11-09T02:47:01.870ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64150 req_id = 7aa91986-661a-4c59-8639-cba55463384e roles = RoleSet { roles: {} } uri = /metrics/producers
16412024-11-09T02:47:01.871ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64150 req_id = 7aa91986-661a-4c59-8639-cba55463384e resource = Database result = Ok(()) uri = /metrics/producers
16422024-11-09T02:47:01.881ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
16432024-11-09T02:47:01.881ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 10413 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64150 req_id = 7aa91986-661a-4c59-8639-cba55463384e response_code = 201 uri = /metrics/producers
16442024-11-09T02:47:03.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
16452024-11-09T02:47:03.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16462024-11-09T02:47:03.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
16472024-11-09T02:47:03.008ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Timeout
16482024-11-09T02:47:03.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
16492024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
16502024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
16512024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
16522024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
16532024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16542024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
16552024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
16562024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
16572024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
16582024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
16592024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
16602024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
16612024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
16622024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
16632024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
16642024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
16652024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
16662024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
16672024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Timeout
16682024-11-09T02:47:03.009ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
16692024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
16702024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
16712024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
16722024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
16732024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16742024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
16752024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
16762024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
16772024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
16782024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
16792024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
16802024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
16812024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
16822024-11-09T02:47:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
16832024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
16842024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
16852024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
16862024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.41\u{b5}s iteration = 2 status = {"errors":[],"records_set_to_done":[]}
16872024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.36\u{b5}s iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
16882024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
16892024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 31.02\u{b5}s iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
16902024-11-09T02:47:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.9\u{b5}s iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
16912024-11-09T02:47:03.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16922024-11-09T02:47:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.017703ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
16932024-11-09T02:47:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16942024-11-09T02:47:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
16952024-11-09T02:47:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
16962024-11-09T02:47:03.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16972024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
16982024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
16992024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
17002024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
17012024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
17022024-11-09T02:47:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
17032024-11-09T02:47:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
17042024-11-09T02:47:03.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
17052024-11-09T02:47:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
17062024-11-09T02:47:03.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17072024-11-09T02:47:03.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17082024-11-09T02:47:03.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17092024-11-09T02:47:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
17102024-11-09T02:47:03.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
17112024-11-09T02:47:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
17122024-11-09T02:47:03.021ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17132024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
17142024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17152024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
17162024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17172024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17182024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17192024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17202024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17212024-11-09T02:47:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17222024-11-09T02:47:03.023ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.733305ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
17232024-11-09T02:47:03.024ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
17242024-11-09T02:47:03.024ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 15.293166ms iteration = 4 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
17252024-11-09T02:47:03.025ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:79 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
17262024-11-09T02:47:03.025ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 16.149604ms iteration = 3 status = {"error":"rack not yet initialized: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29"}
17272024-11-09T02:47:03.025ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 16.642754ms iteration = 2 status = {}
17282024-11-09T02:47:03.025ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17292024-11-09T02:47:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17302024-11-09T02:47:03.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17312024-11-09T02:47:03.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 926, tv_nsec: 368181927 } })
17322024-11-09T02:47:03.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
17332024-11-09T02:47:03.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
17342024-11-09T02:47:03.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17352024-11-09T02:47:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17362024-11-09T02:47:03.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 926, tv_nsec: 369456503 } })
17372024-11-09T02:47:03.028ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
17382024-11-09T02:47:03.028ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 19.794419ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
17392024-11-09T02:47:03.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
17402024-11-09T02:47:03.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
17412024-11-09T02:47:03.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
17422024-11-09T02:47:03.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17432024-11-09T02:47:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17442024-11-09T02:47:03.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17452024-11-09T02:47:03.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17462024-11-09T02:47:03.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17472024-11-09T02:47:03.053ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17482024-11-09T02:47:03.053ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
17492024-11-09T02:47:03.053ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
17502024-11-09T02:47:03.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
17512024-11-09T02:47:03.055ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
17522024-11-09T02:47:03.055ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
17532024-11-09T02:47:03.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 46.722786ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
17542024-11-09T02:47:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
17552024-11-09T02:47:03.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17562024-11-09T02:47:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17572024-11-09T02:47:03.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 66.985965ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
17582024-11-09T02:47:03.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17592024-11-09T02:47:03.095ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17602024-11-09T02:47:03.095ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99b618d9-b3dd-4180-8568-cc5d3874d963", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
17612024-11-09T02:47:03.095ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17622024-11-09T02:47:03.096ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17632024-11-09T02:47:03.108ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
17642024-11-09T02:47:03.108ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
17652024-11-09T02:47:03.109ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b78895a-a3b7-4881-a204-fbace4749131", "content-length": "312", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
17662024-11-09T02:47:03.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17672024-11-09T02:47:03.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17682024-11-09T02:47:03.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17692024-11-09T02:47:03.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17702024-11-09T02:47:03.114ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
17712024-11-09T02:47:03.114ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
17722024-11-09T02:47:03.115ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "69e138bd-72cf-4636-8e62-82ae226d8419", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
17732024-11-09T02:47:03.115ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
17742024-11-09T02:47:03.116ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
17752024-11-09T02:47:03.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17762024-11-09T02:47:03.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17772024-11-09T02:47:03.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17782024-11-09T02:47:03.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17792024-11-09T02:47:03.140ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17802024-11-09T02:47:03.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17812024-11-09T02:47:03.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17822024-11-09T02:47:03.144ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17832024-11-09T02:47:03.144ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17842024-11-09T02:47:03.144ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17852024-11-09T02:47:03.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17862024-11-09T02:47:03.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
17872024-11-09T02:47:03.146ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17882024-11-09T02:47:03.146ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
17892024-11-09T02:47:03.146ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
17902024-11-09T02:47:03.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
17912024-11-09T02:47:03.148ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
17922024-11-09T02:47:03.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
17932024-11-09T02:47:03.148ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 139.82365ms iteration = 2 status = {}
17942024-11-09T02:47:03.148ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "35e2d407-e28d-44cd-9958-b44648792459", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
17952024-11-09T02:47:03.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17962024-11-09T02:47:03.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
17972024-11-09T02:47:03.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
17982024-11-09T02:47:03.152ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
17992024-11-09T02:47:03.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18002024-11-09T02:47:03.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18012024-11-09T02:47:03.156ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18022024-11-09T02:47:03.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18032024-11-09T02:47:03.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18042024-11-09T02:47:03.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18052024-11-09T02:47:03.171ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18062024-11-09T02:47:03.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18072024-11-09T02:47:03.174ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
18082024-11-09T02:47:03.174ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c1bdb6c7-231a-46e9-b210-bd25d4352f59", "content-length": "1", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
18092024-11-09T02:47:03.175ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
18102024-11-09T02:47:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
18112024-11-09T02:47:03.201ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
18122024-11-09T02:47:03.202ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef564785-9b88-484c-b463-edbd328591d5", "content-length": "691", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
18132024-11-09T02:47:03.202ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
18142024-11-09T02:47:03.202ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
18152024-11-09T02:47:03.202ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
18162024-11-09T02:47:03.204ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18172024-11-09T02:47:03.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18182024-11-09T02:47:03.205ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 195.9563ms iteration = 2 status = null
18192024-11-09T02:47:03.205ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 196.110373ms iteration = 2 status = {}
18202024-11-09T02:47:03.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18212024-11-09T02:47:03.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18222024-11-09T02:47:03.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18232024-11-09T02:47:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18242024-11-09T02:47:03.211ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18252024-11-09T02:47:03.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18262024-11-09T02:47:03.217ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18272024-11-09T02:47:03.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18282024-11-09T02:47:03.219ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18292024-11-09T02:47:03.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
18302024-11-09T02:47:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18312024-11-09T02:47:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
18322024-11-09T02:47:03.220ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18332024-11-09T02:47:03.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18342024-11-09T02:47:03.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18352024-11-09T02:47:03.222ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 926, tv_nsec: 563376191 } })
18362024-11-09T02:47:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18372024-11-09T02:47:03.222ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1114
18382024-11-09T02:47:03.224ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18392024-11-09T02:47:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
18402024-11-09T02:47:03.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18412024-11-09T02:47:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18422024-11-09T02:47:03.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18432024-11-09T02:47:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18442024-11-09T02:47:03.234ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18452024-11-09T02:47:03.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18462024-11-09T02:47:03.236ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18472024-11-09T02:47:03.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
18482024-11-09T02:47:03.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18492024-11-09T02:47:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18502024-11-09T02:47:03.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18512024-11-09T02:47:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18522024-11-09T02:47:03.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18532024-11-09T02:47:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18542024-11-09T02:47:03.253ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18552024-11-09T02:47:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18562024-11-09T02:47:03.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18572024-11-09T02:47:03.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18582024-11-09T02:47:03.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
18592024-11-09T02:47:03.258ZDEBGnexus (MgsClient): client request background_task = service_zone_nat_tracker body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
18602024-11-09T02:47:03.258ZDEBGnexus (MgsClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "16b5f4c9-4741-45ec-befc-87c2e741fde7", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
18612024-11-09T02:47:03.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
18622024-11-09T02:47:03.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18632024-11-09T02:47:03.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18642024-11-09T02:47:03.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = service_zone_nat_tracker file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
18652024-11-09T02:47:03.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18662024-11-09T02:47:03.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18672024-11-09T02:47:03.262ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18682024-11-09T02:47:03.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18692024-11-09T02:47:03.264ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18702024-11-09T02:47:03.268ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
18712024-11-09T02:47:03.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18722024-11-09T02:47:03.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18732024-11-09T02:47:03.270ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18742024-11-09T02:47:03.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18752024-11-09T02:47:03.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18762024-11-09T02:47:03.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18772024-11-09T02:47:03.273ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18782024-11-09T02:47:03.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18792024-11-09T02:47:03.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18802024-11-09T02:47:03.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18812024-11-09T02:47:03.278ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18822024-11-09T02:47:03.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18832024-11-09T02:47:03.279ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18842024-11-09T02:47:03.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18852024-11-09T02:47:03.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18862024-11-09T02:47:03.284ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
18872024-11-09T02:47:03.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18882024-11-09T02:47:03.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18892024-11-09T02:47:03.286ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18902024-11-09T02:47:03.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18912024-11-09T02:47:03.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18922024-11-09T02:47:03.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18932024-11-09T02:47:03.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18942024-11-09T02:47:03.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18952024-11-09T02:47:03.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
18962024-11-09T02:47:03.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
18972024-11-09T02:47:03.292ZDEBGnexus (DpdClient): client request background_task = service_zone_nat_tracker body = None method = POST uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger
18982024-11-09T02:47:03.292ZDEBGnexus (DpdClient): client response background_task = service_zone_nat_tracker result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/trigger", status: 200, headers: {"content-type": "application/json", "x-request-id": "65de68c5-133a-4125-925f-82e136e561ac", "content-length": "4", "date": "Sat, 09 Nov 2024 02:47:02 GMT"} })
18992024-11-09T02:47:03.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19002024-11-09T02:47:03.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19012024-11-09T02:47:03.293ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 284.53782ms iteration = 2 status = 6
19022024-11-09T02:47:03.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19032024-11-09T02:47:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19042024-11-09T02:47:03.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-11-09T02:47:03.299ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
19062024-11-09T02:47:03.300ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19072024-11-09T02:47:03.300ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19082024-11-09T02:47:03.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19092024-11-09T02:47:03.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19102024-11-09T02:47:03.303ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19112024-11-09T02:47:03.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19122024-11-09T02:47:03.305ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19132024-11-09T02:47:03.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19142024-11-09T02:47:03.313ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19152024-11-09T02:47:03.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19162024-11-09T02:47:03.314ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19172024-11-09T02:47:03.314ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19182024-11-09T02:47:03.315ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
19192024-11-09T02:47:03.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
19202024-11-09T02:47:03.317ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19212024-11-09T02:47:03.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
19222024-11-09T02:47:03.321ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
19232024-11-09T02:47:03.326ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a42c7fda-8ee0-46b1-b6bd-21d1c130a951", "date": "Sat, 09 Nov 2024 02:47:03 GMT"} })
19242024-11-09T02:47:03.328ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 319.099395ms iteration = 2 status = {}
19252024-11-09T02:47:03.735ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19262024-11-09T02:47:03.735ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19272024-11-09T02:47:03.737ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19282024-11-09T02:47:03.737ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19292024-11-09T02:47:03.738ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19302024-11-09T02:47:03.741ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
19312024-11-09T02:47:03.741ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19322024-11-09T02:47:05.742ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19332024-11-09T02:47:05.743ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19342024-11-09T02:47:05.744ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19352024-11-09T02:47:05.744ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19362024-11-09T02:47:05.746ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19372024-11-09T02:47:05.749ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
19382024-11-09T02:47:05.749ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
19392024-11-09T02:47:07.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19402024-11-09T02:47:07.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19412024-11-09T02:47:07.516ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19422024-11-09T02:47:07.517ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19432024-11-09T02:47:07.517ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19442024-11-09T02:47:07.517ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19452024-11-09T02:47:07.538ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19462024-11-09T02:47:07.538ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19472024-11-09T02:47:07.540ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19482024-11-09T02:47:07.540ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19492024-11-09T02:47:07.542ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19502024-11-09T02:47:07.545ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19512024-11-09T02:47:07.545ZDEBGnexus (dropshot_internal): updating rack subnet for rack 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19522024-11-09T02:47:07.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19532024-11-09T02:47:07.545ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19542024-11-09T02:47:07.550ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19552024-11-09T02:47:07.580ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19562024-11-09T02:47:07.581ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5a03dbe-4508-472e-b1dd-cceae3243673", "content-length": "24", "date": "Sat, 09 Nov 2024 02:47:06 GMT"} }) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19572024-11-09T02:47:07.581ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19582024-11-09T02:47:07.581ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19592024-11-09T02:47:07.581ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19602024-11-09T02:47:07.581ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19612024-11-09T02:47:07.590ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19622024-11-09T02:47:07.590ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19632024-11-09T02:47:07.590ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19642024-11-09T02:47:07.608ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19652024-11-09T02:47:07.608ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19662024-11-09T02:47:07.617ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19672024-11-09T02:47:07.617ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19682024-11-09T02:47:07.619ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19692024-11-09T02:47:07.619ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19702024-11-09T02:47:07.626ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19712024-11-09T02:47:07.626ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19722024-11-09T02:47:07.641ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19732024-11-09T02:47:07.643ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19742024-11-09T02:47:07.643ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19752024-11-09T02:47:07.644ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19762024-11-09T02:47:07.646ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19772024-11-09T02:47:07.646ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19782024-11-09T02:47:07.646ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19792024-11-09T02:47:07.648ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19802024-11-09T02:47:07.648ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19812024-11-09T02:47:07.650ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19822024-11-09T02:47:07.652ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19832024-11-09T02:47:07.652ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19842024-11-09T02:47:07.652ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19852024-11-09T02:47:07.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19862024-11-09T02:47:07.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19872024-11-09T02:47:07.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19882024-11-09T02:47:07.657ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = IpPool { parent: Fleet, key: 07bda856-544d-427e-a627-eba08db6d857, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19892024-11-09T02:47:07.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19902024-11-09T02:47:07.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19912024-11-09T02:47:07.669ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19922024-11-09T02:47:07.671ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
19932024-11-09T02:47:07.750ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19942024-11-09T02:47:07.751ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19952024-11-09T02:47:07.752ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
19962024-11-09T02:47:07.752ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
19972024-11-09T02:47:07.754ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19982024-11-09T02:47:07.756ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
19992024-11-09T02:47:07.756ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, time_created: 2024-11-09T02:46:32.927704Z, time_modified: 2024-11-09T02:46:32.927704Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
20002024-11-09T02:47:07.775ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 file = nexus/db-queries/src/db/datastore/deployment.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20012024-11-09T02:47:07.775ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20022024-11-09T02:47:07.775ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20032024-11-09T02:47:07.777ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20042024-11-09T02:47:07.779ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = BlueprintConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20052024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20062024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20072024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20082024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20092024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20102024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20112024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20122024-11-09T02:47:07.789ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20132024-11-09T02:47:07.847ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20142024-11-09T02:47:07.867ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20152024-11-09T02:47:07.885ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20162024-11-09T02:47:07.903ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20172024-11-09T02:47:07.927ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20182024-11-09T02:47:07.927ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20192024-11-09T02:47:07.927ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20202024-11-09T02:47:07.927ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20212024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20222024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20232024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20242024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20252024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20262024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20272024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20282024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20292024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20302024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20312024-11-09T02:47:07.928ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20322024-11-09T02:47:07.949ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20332024-11-09T02:47:07.949ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:808 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20342024-11-09T02:47:07.949ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 4d3e084b-214a-46ae-baed-e04e00554917, time_created: 2024-11-09T02:47:07.517765994Z, time_modified: 2024-11-09T02:47:07.517765994Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20352024-11-09T02:47:07.950ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20362024-11-09T02:47:07.950ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20372024-11-09T02:47:07.951ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20382024-11-09T02:47:07.953ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20392024-11-09T02:47:07.981ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 53c51f8b-256c-4157-b1c1-60bcbd6b8737, time_created: 2024-11-09T02:47:07.517766454Z, time_modified: 2024-11-09T02:47:07.517766454Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20402024-11-09T02:47:07.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20412024-11-09T02:47:07.981ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20422024-11-09T02:47:07.983ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20432024-11-09T02:47:07.985ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20442024-11-09T02:47:07.989ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: dc3854b2-62ab-4ec0-9afb-5993bd9aafde, time_created: 2024-11-09T02:47:07.517766554Z, time_modified: 2024-11-09T02:47:07.517766554Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20452024-11-09T02:47:07.989ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20462024-11-09T02:47:07.989ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20472024-11-09T02:47:07.991ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20482024-11-09T02:47:07.993ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20492024-11-09T02:47:07.997ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 76670b3b-776e-4857-af51-465a30d486d2, time_created: 2024-11-09T02:47:07.517766654Z, time_modified: 2024-11-09T02:47:07.517766654Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20502024-11-09T02:47:07.997ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20512024-11-09T02:47:07.997ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20522024-11-09T02:47:07.999ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20532024-11-09T02:47:08.000ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20542024-11-09T02:47:08.005ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 554f59ae-b23f-497d-8acf-32b9f1f65c3c, time_created: 2024-11-09T02:47:07.517766724Z, time_modified: 2024-11-09T02:47:07.517766724Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20552024-11-09T02:47:08.005ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20562024-11-09T02:47:08.005ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20572024-11-09T02:47:08.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20582024-11-09T02:47:08.008ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20592024-11-09T02:47:08.012ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: c0696728-a1b0-4953-be39-29cad86f7b75, time_created: 2024-11-09T02:47:07.517767054Z, time_modified: 2024-11-09T02:47:07.517767054Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20602024-11-09T02:47:08.012ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20612024-11-09T02:47:08.013ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20622024-11-09T02:47:08.014ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20632024-11-09T02:47:08.016ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20642024-11-09T02:47:08.020ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b7dec911-d4d9-4524-9ddd-751d9c2f2719, time_created: 2024-11-09T02:47:07.517767124Z, time_modified: 2024-11-09T02:47:07.517767124Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20652024-11-09T02:47:08.020ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20662024-11-09T02:47:08.020ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20672024-11-09T02:47:08.022ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20682024-11-09T02:47:08.024ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20692024-11-09T02:47:08.028ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 597cd284-a042-4532-9280-c5ceef96f9dc, time_created: 2024-11-09T02:47:07.517767194Z, time_modified: 2024-11-09T02:47:07.517767194Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20702024-11-09T02:47:08.028ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20712024-11-09T02:47:08.028ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20722024-11-09T02:47:08.030ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20732024-11-09T02:47:08.032ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20742024-11-09T02:47:08.036ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: fa782f29-5423-4acd-85d3-02fc6f0aa5e5, time_created: 2024-11-09T02:47:07.517767264Z, time_modified: 2024-11-09T02:47:07.517767264Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: f032ba4a-ac68-41c0-a068-00d3371df648, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:811 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20752024-11-09T02:47:08.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20762024-11-09T02:47:08.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20772024-11-09T02:47:08.038ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20782024-11-09T02:47:08.039ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20792024-11-09T02:47:08.043ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:823 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20802024-11-09T02:47:08.044ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20812024-11-09T02:47:08.044ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20822024-11-09T02:47:08.045ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20832024-11-09T02:47:08.046ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20842024-11-09T02:47:08.060ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20852024-11-09T02:47:08.060ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20862024-11-09T02:47:08.061ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20872024-11-09T02:47:08.062ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20882024-11-09T02:47:08.067ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20892024-11-09T02:47:08.068ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20902024-11-09T02:47:08.069ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20912024-11-09T02:47:08.070ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20922024-11-09T02:47:08.075ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20932024-11-09T02:47:08.075ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20942024-11-09T02:47:08.077ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20952024-11-09T02:47:08.078ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20962024-11-09T02:47:08.082ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20972024-11-09T02:47:08.082ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20982024-11-09T02:47:08.084ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
20992024-11-09T02:47:08.085ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21002024-11-09T02:47:08.089ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21012024-11-09T02:47:08.090ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21022024-11-09T02:47:08.091ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21032024-11-09T02:47:08.092ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21042024-11-09T02:47:08.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21052024-11-09T02:47:08.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21062024-11-09T02:47:08.097ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21072024-11-09T02:47:08.099ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21082024-11-09T02:47:08.108ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21092024-11-09T02:47:08.108ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21102024-11-09T02:47:08.110ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21112024-11-09T02:47:08.111ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21122024-11-09T02:47:08.115ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21132024-11-09T02:47:08.116ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21142024-11-09T02:47:08.117ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21152024-11-09T02:47:08.118ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21162024-11-09T02:47:08.123ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:835 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21172024-11-09T02:47:08.227ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:865 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21182024-11-09T02:47:08.252ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:876 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21192024-11-09T02:47:08.255ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:885 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21202024-11-09T02:47:08.255ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21212024-11-09T02:47:08.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21222024-11-09T02:47:08.257ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21232024-11-09T02:47:08.259ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21242024-11-09T02:47:08.259ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21252024-11-09T02:47:08.259ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21262024-11-09T02:47:08.260ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21272024-11-09T02:47:08.262ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21282024-11-09T02:47:08.292ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21292024-11-09T02:47:08.293ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21302024-11-09T02:47:08.294ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21312024-11-09T02:47:08.297ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = DnsConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21322024-11-09T02:47:08.297ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21332024-11-09T02:47:08.297ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21342024-11-09T02:47:08.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21352024-11-09T02:47:08.301ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = DnsConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21362024-11-09T02:47:08.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21372024-11-09T02:47:08.303ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21382024-11-09T02:47:08.305ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21392024-11-09T02:47:08.308ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = DnsConfig result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21402024-11-09T02:47:08.315ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21412024-11-09T02:47:08.326ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21422024-11-09T02:47:08.338ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21432024-11-09T02:47:08.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21442024-11-09T02:47:08.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21452024-11-09T02:47:08.340ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21462024-11-09T02:47:08.340ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21472024-11-09T02:47:08.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21482024-11-09T02:47:08.343ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21492024-11-09T02:47:08.343ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21502024-11-09T02:47:08.347ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21512024-11-09T02:47:08.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21522024-11-09T02:47:08.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21532024-11-09T02:47:08.348ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21542024-11-09T02:47:08.350ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21552024-11-09T02:47:08.365ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21562024-11-09T02:47:08.365ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21572024-11-09T02:47:08.368ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21582024-11-09T02:47:08.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21592024-11-09T02:47:08.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21602024-11-09T02:47:08.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21612024-11-09T02:47:08.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21622024-11-09T02:47:08.372ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21632024-11-09T02:47:08.373ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21642024-11-09T02:47:08.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21652024-11-09T02:47:08.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21662024-11-09T02:47:08.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21672024-11-09T02:47:08.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21682024-11-09T02:47:08.381ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21692024-11-09T02:47:08.381ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21702024-11-09T02:47:08.381ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21712024-11-09T02:47:08.382ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21722024-11-09T02:47:08.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21732024-11-09T02:47:08.384ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21742024-11-09T02:47:08.384ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21752024-11-09T02:47:08.386ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21762024-11-09T02:47:08.389ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21772024-11-09T02:47:08.389ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21782024-11-09T02:47:08.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21792024-11-09T02:47:08.392ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21802024-11-09T02:47:08.393ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21812024-11-09T02:47:08.394ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21822024-11-09T02:47:08.394ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21832024-11-09T02:47:08.396ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21842024-11-09T02:47:08.396ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21852024-11-09T02:47:08.397ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21862024-11-09T02:47:08.397ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21872024-11-09T02:47:08.399ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21882024-11-09T02:47:08.399ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21892024-11-09T02:47:08.400ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21902024-11-09T02:47:08.400ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21912024-11-09T02:47:08.401ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21922024-11-09T02:47:08.404ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21932024-11-09T02:47:08.404ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21942024-11-09T02:47:08.405ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21952024-11-09T02:47:08.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21962024-11-09T02:47:08.406ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21972024-11-09T02:47:08.407ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21982024-11-09T02:47:08.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
21992024-11-09T02:47:08.409ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22002024-11-09T02:47:08.409ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22012024-11-09T02:47:08.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22022024-11-09T02:47:08.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22032024-11-09T02:47:08.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22042024-11-09T02:47:08.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22052024-11-09T02:47:08.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22062024-11-09T02:47:08.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22072024-11-09T02:47:08.415ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22082024-11-09T02:47:08.418ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22092024-11-09T02:47:08.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22102024-11-09T02:47:08.418ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22112024-11-09T02:47:08.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22122024-11-09T02:47:08.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22132024-11-09T02:47:08.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22142024-11-09T02:47:08.421ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22152024-11-09T02:47:08.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22162024-11-09T02:47:08.426ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22172024-11-09T02:47:08.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22182024-11-09T02:47:08.426ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22192024-11-09T02:47:08.433ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22202024-11-09T02:47:08.433ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22212024-11-09T02:47:08.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22222024-11-09T02:47:08.435ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22232024-11-09T02:47:08.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22242024-11-09T02:47:08.436ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22252024-11-09T02:47:08.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22262024-11-09T02:47:08.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22272024-11-09T02:47:08.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22282024-11-09T02:47:08.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22292024-11-09T02:47:08.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22302024-11-09T02:47:08.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22312024-11-09T02:47:08.442ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22322024-11-09T02:47:08.443ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22332024-11-09T02:47:08.444ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22342024-11-09T02:47:08.447ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22352024-11-09T02:47:08.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22362024-11-09T02:47:08.447ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22372024-11-09T02:47:08.448ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22382024-11-09T02:47:08.449ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22392024-11-09T02:47:08.450ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22402024-11-09T02:47:08.450ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22412024-11-09T02:47:08.451ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22422024-11-09T02:47:08.455ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22432024-11-09T02:47:08.455ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22442024-11-09T02:47:08.455ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22452024-11-09T02:47:08.463ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
22462024-11-09T02:47:08.463ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22472024-11-09T02:47:08.463ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22482024-11-09T02:47:08.464ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22492024-11-09T02:47:08.466ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Fleet result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22502024-11-09T02:47:08.466ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 roles = RoleSet { roles: {} } uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22512024-11-09T02:47:08.466ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 resource = Database result = Ok(()) uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22522024-11-09T02:47:08.477ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
22532024-11-09T02:47:08.480ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
22542024-11-09T02:47:08.480ZDEBGnexus: resolved 2 rules for sleds
22552024-11-09T02:47:08.523ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
22562024-11-09T02:47:08.523ZDEBGnexus: sending firewall rules to sled agents
22572024-11-09T02:47:08.523ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22582024-11-09T02:47:08.523ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22592024-11-09T02:47:08.526ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
22602024-11-09T02:47:08.526ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
22612024-11-09T02:47:08.527ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
22622024-11-09T02:47:08.529ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
22632024-11-09T02:47:08.559ZDEBGnexus: client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
22642024-11-09T02:47:08.562ZDEBGnexus: client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "3d7df210-49d9-4eb8-96c6-3128534e2b11", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
22652024-11-09T02:47:08.562ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
22662024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
22672024-11-09T02:47:08.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1049114 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:64381 req_id = f7e2b56c-7207-4f06-88d2-b76c3a46d647 response_code = 204 uri = /racks/5bbfcf9f-0313-44b5-8699-fd964d8a4a29/initialization-complete
22682024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
22692024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
22702024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22712024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
22722024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
22732024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
22742024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
22752024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22762024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
22772024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
22782024-11-09T02:47:08.562ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22792024-11-09T02:47:08.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22802024-11-09T02:47:08.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
22812024-11-09T02:47:08.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22822024-11-09T02:47:08.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22832024-11-09T02:47:08.563ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 931, tv_nsec: 904261576 } })
22842024-11-09T02:47:08.563ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 931, tv_nsec: 904424349 } })
22852024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
22862024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.124483ms iteration = 2 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
22872024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
22882024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.164024ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
22892024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22902024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
22912024-11-09T02:47:08.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
22922024-11-09T02:47:08.565ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
22932024-11-09T02:47:08.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
22942024-11-09T02:47:08.565ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22952024-11-09T02:47:08.566ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
22962024-11-09T02:47:08.566ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
22972024-11-09T02:47:08.566ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
22982024-11-09T02:47:08.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
22992024-11-09T02:47:08.567ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
23002024-11-09T02:47:08.567ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23012024-11-09T02:47:08.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23022024-11-09T02:47:08.567ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23032024-11-09T02:47:08.569ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23042024-11-09T02:47:08.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23052024-11-09T02:47:08.569ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23062024-11-09T02:47:08.570ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23072024-11-09T02:47:08.571ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23082024-11-09T02:47:08.571ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(babcbb52-0146-4325-bd58-0bf30cabbe14, 0), (bb5f090b-6d54-48ce-bdc0-b8acfa4298d5, 0), (aee3d201-e34c-48bf-ac54-35a88124914c, 0), (ae7eda3c-463c-4531-b460-1654db48aec5, 0)] collection_id = babcbb52-0146-4325-bd58-0bf30cabbe14
23092024-11-09T02:47:08.571ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23102024-11-09T02:47:08.571ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23112024-11-09T02:47:08.573ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
23122024-11-09T02:47:08.573ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23132024-11-09T02:47:08.574ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23142024-11-09T02:47:08.599ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
23152024-11-09T02:47:08.599ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
23162024-11-09T02:47:08.599ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
23172024-11-09T02:47:08.599ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23182024-11-09T02:47:08.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23192024-11-09T02:47:08.601ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23202024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
23212024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
23222024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
23232024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23242024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23252024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23262024-11-09T02:47:08.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23272024-11-09T02:47:08.605ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23282024-11-09T02:47:08.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23292024-11-09T02:47:08.607ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
23302024-11-09T02:47:08.607ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
23312024-11-09T02:47:08.607ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23322024-11-09T02:47:08.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23332024-11-09T02:47:08.608ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23342024-11-09T02:47:08.609ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23352024-11-09T02:47:08.609ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23362024-11-09T02:47:08.610ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23372024-11-09T02:47:08.611ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
23382024-11-09T02:47:08.611ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
23392024-11-09T02:47:08.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
23402024-11-09T02:47:08.616ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23412024-11-09T02:47:08.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23422024-11-09T02:47:08.618ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23432024-11-09T02:47:08.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
23442024-11-09T02:47:08.620ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
23452024-11-09T02:47:08.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
23462024-11-09T02:47:08.622ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
23472024-11-09T02:47:08.622ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
23482024-11-09T02:47:08.622ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
23492024-11-09T02:47:08.622ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 59.120302ms iteration = 2 status = {"generation":2}
23502024-11-09T02:47:08.622ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
23512024-11-09T02:47:08.638ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
23522024-11-09T02:47:08.638ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
23532024-11-09T02:47:08.638ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23542024-11-09T02:47:08.638ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23552024-11-09T02:47:08.639ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
23562024-11-09T02:47:08.640ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = babcbb52-0146-4325-bd58-0bf30cabbe14 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
23572024-11-09T02:47:08.640ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
23582024-11-09T02:47:08.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
23592024-11-09T02:47:08.643ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(bb5f090b-6d54-48ce-bdc0-b8acfa4298d5, 0), (aee3d201-e34c-48bf-ac54-35a88124914c, 0), (ae7eda3c-463c-4531-b460-1654db48aec5, 0)]
23602024-11-09T02:47:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
23612024-11-09T02:47:08.643ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 931, tv_nsec: 984451143 } })
23622024-11-09T02:47:08.643ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
23632024-11-09T02:47:08.643ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
23642024-11-09T02:47:08.646ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
23652024-11-09T02:47:08.646ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
23662024-11-09T02:47:08.646ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
23672024-11-09T02:47:08.646ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 83.206189ms iteration = 2 status = {"generation":1}
23682024-11-09T02:47:08.646ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
23692024-11-09T02:47:08.658ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
23702024-11-09T02:47:08.663ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
23712024-11-09T02:47:08.663ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 100.098829ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
23722024-11-09T02:47:08.697ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
23732024-11-09T02:47:08.698ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
23742024-11-09T02:47:08.698ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
23752024-11-09T02:47:08.698ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
23762024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "25ff3a4f-e7aa-46cb-9b1c-3d6b0b703104", "content-length": "476", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23772024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
23782024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b97900a-c95a-4c1a-abae-d9e058a68751", "content-length": "734", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23792024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
23802024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0e9e768-440b-4edd-9fdd-203221c2e1f3", "content-length": "111", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23812024-11-09T02:47:08.699ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
23822024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "57e33349-8a16-41bc-823f-e7436158a0cc", "content-length": "111", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23832024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
23842024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b3e564a4-1630-4fb5-87ea-64f920b5c1c8", "content-length": "167", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23852024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
23862024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "a6039f36-bf35-48f3-a2bb-e4ead4e69c44", "content-length": "167", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23872024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
23882024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "b792763b-913a-4c20-be6b-eb1a75895670", "content-length": "175", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23892024-11-09T02:47:08.700ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
23902024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "69990b7b-7877-4cca-9ed6-f5d38cd278b0", "content-length": "175", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23912024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
23922024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "deb0f84d-3c49-419f-be73-0d0f97d5904b", "content-length": "702", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23932024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23942024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec789b57-d71c-4df0-a94d-2125afe53a60", "content-length": "727", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23952024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23962024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "c62e966c-45d0-4587-9f8d-4177901b96e0", "content-length": "729", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23972024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
23982024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "88bfa73f-7d4d-461a-8cdd-9d6493878078", "content-length": "728", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
23992024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
24002024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f762c846-6e27-4f53-b7c1-c588bf022bf3", "content-length": "722", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24012024-11-09T02:47:08.701ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
24022024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "990e0560-6312-430c-ba4a-597104f51bdf", "content-length": "109", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24032024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
24042024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7f59fc1-0f36-4021-8924-92846aa3f83b", "content-length": "109", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24052024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
24062024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9ad863b1-649b-4044-8945-7671ce033bf3", "content-length": "169", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24072024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
24082024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "929bab4a-c8fa-4763-a5c1-3bf7a56be6aa", "content-length": "169", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24092024-11-09T02:47:08.702ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
24102024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1acecc53-cf66-48bd-b1dc-a1ac86db7602", "content-length": "178", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24112024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
24122024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f018f61-f475-4300-8b47-3f68bccc86d4", "content-length": "178", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24132024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
24142024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff32d9d1-7b7a-413f-ae50-2941273cb4c3", "content-length": "702", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24152024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
24162024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "29ebcccd-644a-4ac6-8d59-bb289750cbba", "content-length": "727", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24172024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
24182024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "3daae8b1-dc64-451b-b87b-8525cd2e554e", "content-length": "729", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24192024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
24202024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b4b75ac-ecd7-40d8-a41c-0afc0d1a8522", "content-length": "728", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24212024-11-09T02:47:08.703ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24222024-11-09T02:47:08.704ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24232024-11-09T02:47:08.705ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
24242024-11-09T02:47:08.705ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24252024-11-09T02:47:08.707ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
24262024-11-09T02:47:08.707ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24272024-11-09T02:47:08.707ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24282024-11-09T02:47:08.709ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24292024-11-09T02:47:08.711ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
24302024-11-09T02:47:08.711ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24312024-11-09T02:47:08.712ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24322024-11-09T02:47:08.727ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "849bf428-3a71-4a88-8cf2-9aec10936222", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24332024-11-09T02:47:08.727ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24342024-11-09T02:47:08.729ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "3dc7fa58-0396-4757-b578-fc67c260700a", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24352024-11-09T02:47:08.729ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24362024-11-09T02:47:08.731ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
24372024-11-09T02:47:08.731ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 109.580285ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
24382024-11-09T02:47:08.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
24392024-11-09T02:47:08.753ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
24402024-11-09T02:47:08.753ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
24412024-11-09T02:47:08.769ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
24422024-11-09T02:47:08.784ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "4ed32179-ba5b-4039-a1d5-cc88395dab77", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24432024-11-09T02:47:08.784ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24442024-11-09T02:47:08.785ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "74d2c9fc-7b50-48a8-a5cf-627db0361287", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24452024-11-09T02:47:08.785ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24462024-11-09T02:47:08.791ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b732d607-393c-46d2-8ebf-e3a4512c5efa", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24472024-11-09T02:47:08.791ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24482024-11-09T02:47:08.792ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
24492024-11-09T02:47:08.792ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 146.538188ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
24502024-11-09T02:47:08.957ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "1234bf2c-0450-4306-926b-157d369b2962", "content-length": "29179", "date": "Sat, 09 Nov 2024 02:47:08 GMT"} })
24512024-11-09T02:47:08.958ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
24522024-11-09T02:47:08.960ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24532024-11-09T02:47:08.960ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24542024-11-09T02:47:08.962ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24552024-11-09T02:47:08.964ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
24562024-11-09T02:47:08.964ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
24572024-11-09T02:47:08.964ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
24582024-11-09T02:47:09.232ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 49c72ac0-6fc5-47c7-a85f-9108666236bb file = nexus/db-queries/src/db/datastore/inventory.rs:1000
24592024-11-09T02:47:09.232ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 49c72ac0-6fc5-47c7-a85f-9108666236bb time_started = 2024-11-09 02:47:08.698445 UTC
24602024-11-09T02:47:09.232ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 669.339243ms iteration = 2 status = {"collection_id":"49c72ac0-6fc5-47c7-a85f-9108666236bb","time_done":"2024-11-09 02:47:08.958923 UTC","time_started":"2024-11-09 02:47:08.698445 UTC"}
24612024-11-09T02:47:09.232ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Dependency
24622024-11-09T02:47:09.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24632024-11-09T02:47:09.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24642024-11-09T02:47:09.234ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24652024-11-09T02:47:09.236ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24662024-11-09T02:47:09.236ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24672024-11-09T02:47:09.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24682024-11-09T02:47:09.238ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24692024-11-09T02:47:09.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24702024-11-09T02:47:09.240ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24712024-11-09T02:47:09.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
24722024-11-09T02:47:09.242ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
24732024-11-09T02:47:09.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
24742024-11-09T02:47:09.259ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 27.411037ms iteration = 4 status = {"physical_disks_added":0}
24752024-11-09T02:47:09.757ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
24762024-11-09T02:47:09.757ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
24772024-11-09T02:47:09.759ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
24782024-11-09T02:47:09.759ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
24792024-11-09T02:47:09.760ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24802024-11-09T02:47:09.763ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, lookup_type: ById(5bbfcf9f-0313-44b5-8699-fd964d8a4a29) } result = Ok(())
24812024-11-09T02:47:09.763ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
24822024-11-09T02:47:09.763ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24832024-11-09T02:47:09.763ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24842024-11-09T02:47:09.765ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24852024-11-09T02:47:09.765ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24862024-11-09T02:47:09.766ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24872024-11-09T02:47:09.766ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24882024-11-09T02:47:09.768ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24892024-11-09T02:47:09.768ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24902024-11-09T02:47:09.770ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24912024-11-09T02:47:09.770ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24922024-11-09T02:47:09.771ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24932024-11-09T02:47:09.771ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24942024-11-09T02:47:09.773ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
24952024-11-09T02:47:09.776ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
24962024-11-09T02:47:09.776ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24972024-11-09T02:47:09.776ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
24982024-11-09T02:47:09.777ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
24992024-11-09T02:47:09.777ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25002024-11-09T02:47:09.778ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25012024-11-09T02:47:09.779ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25022024-11-09T02:47:09.780ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25032024-11-09T02:47:09.783ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25042024-11-09T02:47:09.783ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25052024-11-09T02:47:09.783ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25062024-11-09T02:47:09.785ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25072024-11-09T02:47:09.785ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25082024-11-09T02:47:09.787ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25092024-11-09T02:47:09.787ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25102024-11-09T02:47:09.788ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25112024-11-09T02:47:09.789ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25122024-11-09T02:47:09.790ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25132024-11-09T02:47:09.790ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25142024-11-09T02:47:09.791ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25152024-11-09T02:47:09.791ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25162024-11-09T02:47:09.793ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25172024-11-09T02:47:09.793ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25182024-11-09T02:47:09.794ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25192024-11-09T02:47:09.797ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
25202024-11-09T02:47:09.797ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25212024-11-09T02:47:09.797ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25222024-11-09T02:47:09.798ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25232024-11-09T02:47:09.799ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25242024-11-09T02:47:09.800ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25252024-11-09T02:47:09.800ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25262024-11-09T02:47:09.802ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25272024-11-09T02:47:09.802ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25282024-11-09T02:47:09.804ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25292024-11-09T02:47:09.804ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25302024-11-09T02:47:09.805ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25312024-11-09T02:47:09.805ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25322024-11-09T02:47:09.807ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25332024-11-09T02:47:09.807ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25342024-11-09T02:47:09.808ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25352024-11-09T02:47:09.811ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25362024-11-09T02:47:09.811ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25372024-11-09T02:47:09.811ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25382024-11-09T02:47:09.813ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25392024-11-09T02:47:09.813ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25402024-11-09T02:47:09.814ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25412024-11-09T02:47:09.814ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25422024-11-09T02:47:09.815ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25432024-11-09T02:47:09.819ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
25442024-11-09T02:47:09.819ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25452024-11-09T02:47:09.819ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25462024-11-09T02:47:09.822ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25472024-11-09T02:47:09.822ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25482024-11-09T02:47:09.823ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25492024-11-09T02:47:09.823ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25502024-11-09T02:47:09.825ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25512024-11-09T02:47:09.825ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25522024-11-09T02:47:09.827ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25532024-11-09T02:47:09.827ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25542024-11-09T02:47:09.828ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25552024-11-09T02:47:09.829ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25562024-11-09T02:47:09.830ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25572024-11-09T02:47:09.830ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25582024-11-09T02:47:09.831ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25592024-11-09T02:47:09.831ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25602024-11-09T02:47:09.832ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25612024-11-09T02:47:09.836ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25622024-11-09T02:47:09.836ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25632024-11-09T02:47:09.836ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25642024-11-09T02:47:09.837ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25652024-11-09T02:47:09.837ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25662024-11-09T02:47:09.838ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25672024-11-09T02:47:09.838ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25682024-11-09T02:47:09.840ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25692024-11-09T02:47:09.843ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
25702024-11-09T02:47:09.843ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25712024-11-09T02:47:09.843ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25722024-11-09T02:47:09.849ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
25732024-11-09T02:47:09.849ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25742024-11-09T02:47:09.849ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25752024-11-09T02:47:09.850ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25762024-11-09T02:47:09.852ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
25772024-11-09T02:47:09.852ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25782024-11-09T02:47:09.852ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25792024-11-09T02:47:09.853ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
25802024-11-09T02:47:09.854ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
25812024-11-09T02:47:09.854ZDEBGnexus (InternalApi): resolved 2 rules for sleds
25822024-11-09T02:47:09.891ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
25832024-11-09T02:47:09.891ZDEBGnexus (InternalApi): sending firewall rules to sled agents
25842024-11-09T02:47:09.891ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25852024-11-09T02:47:09.892ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25862024-11-09T02:47:09.893ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
25872024-11-09T02:47:09.894ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
25882024-11-09T02:47:09.895ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
25892024-11-09T02:47:09.898ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
25902024-11-09T02:47:09.927ZDEBGnexus (InternalApi): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
25912024-11-09T02:47:09.928ZDEBGnexus (InternalApi): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "d29098ce-0455-45b9-b662-c6498f80884d", "date": "Sat, 09 Nov 2024 02:47:09 GMT"} })
25922024-11-09T02:47:09.928ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
25932024-11-09T02:47:09.928ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
25942024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /
25952024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access
25962024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path}
25972024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth
25982024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm
25992024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success
26002024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token
26012024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify
26022024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes
26032024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes
26042024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe}
26052024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe}
26062024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images
26072024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login
26082024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local
26092024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}
26102024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name}
26112024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
26122024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path}
26132024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path}
26142024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new
26152024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path}
26162024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path}
26172024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization
26182024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates
26192024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates
26202024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate}
26212024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate}
26222024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks
26232024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks
26242024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk}
26252024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}
26262024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write
26272024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start
26282024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop
26292024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize
26302024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric}
26312024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips
26322024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips
26332024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip}
26342024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip}
26352024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip}
26362024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach
26372024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach
26382024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups
26392024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id}
26402024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images
26412024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images
26422024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image}
26432024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image}
26442024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote
26452024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote
26462024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances
26472024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances
26482024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}
26492024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}
26502024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance}
26512024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks
26522024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach
26532024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach
26542024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips
26552024-11-09T02:47:09.938ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
26562024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
26572024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot
26582024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console
26592024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream
26602024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys
26612024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start
26622024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop
26632024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses
26642024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses
26652024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
26662024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools
26672024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools
26682024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
26692024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways
26702024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways
26712024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway}
26722024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway}
26732024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools
26742024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool}
26752024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local
26762024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout
26772024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me
26782024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups
26792024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys
26802024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys
26812024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
26822024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key}
26832024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name}
26842024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces
26852024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces
26862024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface}
26872024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface}
26882024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface}
26892024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping
26902024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy
26912024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy
26922024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects
26932024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects
26942024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project}
26952024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}
26962024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}
26972024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy
26982024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy
26992024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots
27002024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots
27012024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot}
27022024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot}
27032024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks
27042024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id}
27052024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks
27062024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id}
27072024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds
27082024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds
27092024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}
27102024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
27112024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
27122024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
27132024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized
27142024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port
27152024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
27162024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings
27172024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status
27182024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches
27192024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id}
27202024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers
27212024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users
27222024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
27232024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
27242024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml
27252024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider}
27262024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools
27272024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools
27282024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}
27292024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}
27302024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}
27312024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges
27322024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
27332024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
27342024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos
27352024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos
27362024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
27372024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
27382024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization
27392024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service
27402024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges
27412024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add
27422024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove
27432024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name}
27442024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot
27452024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot
27462024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
27472024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
27482024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list
27492024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list
27502024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable
27512024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable
27522024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status
27532024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp
27542024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp
27552024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp
27562024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set
27572024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set
27582024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
27592024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
27602024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported
27612024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history
27622024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4
27632024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status
27642024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address
27652024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address
27662024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
27672024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings
27682024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings
27692024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings
27702024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port}
27712024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy
27722024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy
27732024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles
27742024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name}
27752024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas
27762024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos
27772024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos
27782024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo}
27792024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}
27802024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools
27812024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy
27822024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy
27832024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas
27842024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas
27852024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository
27862024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version}
27872024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users
27882024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id}
27892024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin
27902024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user}
27912024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos
27922024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo}
27932024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query
27942024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/timeseries/schema
27952024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users
27962024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization
27972024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules
27982024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules
27992024-11-09T02:47:09.939ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes
28002024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes
28012024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route}
28022024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route}
28032024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route}
28042024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers
28052024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers
28062024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router}
28072024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router}
28082024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router}
28092024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets
28102024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets
28112024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet}
28122024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}
28132024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet}
28142024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
28152024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs
28162024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs
28172024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc}
28182024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc}
28192024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc}
28202024-11-09T02:47:09.940ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = 172.30.2.7:443
28212024-11-09T02:47:09.940ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
28222024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /
28232024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access
28242024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path}
28252024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth
28262024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm
28272024-11-09T02:47:09.943ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success
28282024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token
28292024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify
28302024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes
28312024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes
28322024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe}
28332024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe}
28342024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images
28352024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login
28362024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local
28372024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}
28382024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name}
28392024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect
28402024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path}
28412024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path}
28422024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new
28432024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path}
28442024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path}
28452024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization
28462024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates
28472024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates
28482024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate}
28492024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate}
28502024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks
28512024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks
28522024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk}
28532024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}
28542024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write
28552024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start
28562024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop
28572024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize
28582024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric}
28592024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips
28602024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips
28612024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip}
28622024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip}
28632024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip}
28642024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach
28652024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach
28662024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups
28672024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id}
28682024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images
28692024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images
28702024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image}
28712024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image}
28722024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote
28732024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote
28742024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances
28752024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances
28762024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}
28772024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}
28782024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance}
28792024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks
28802024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach
28812024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach
28822024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips
28832024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral
28842024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral
28852024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot
28862024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console
28872024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream
28882024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys
28892024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start
28902024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop
28912024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses
28922024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses
28932024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address}
28942024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools
28952024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools
28962024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool}
28972024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways
28982024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways
28992024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway}
29002024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway}
29012024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools
29022024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool}
29032024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local
29042024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout
29052024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me
29062024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups
29072024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys
29082024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys
29092024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key}
29102024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key}
29112024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name}
29122024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces
29132024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces
29142024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface}
29152024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface}
29162024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface}
29172024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping
29182024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy
29192024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy
29202024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects
29212024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects
29222024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project}
29232024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}
29242024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}
29252024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy
29262024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy
29272024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots
29282024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots
29292024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot}
29302024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot}
29312024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks
29322024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id}
29332024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks
29342024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id}
29352024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds
29362024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds
29372024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}
29382024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks
29392024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances
29402024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy
29412024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized
29422024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port
29432024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings
29442024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings
29452024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status
29462024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches
29472024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id}
29482024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers
29492024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users
29502024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id}
29512024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password
29522024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml
29532024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider}
29542024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools
29552024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools
29562024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}
29572024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}
29582024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}
29592024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges
29602024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add
29612024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove
29622024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos
29632024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos
29642024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo}
29652024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo}
29662024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization
29672024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service
29682024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges
29692024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add
29702024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove
29712024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name}
29722024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot
29732024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot
29742024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot}
29752024-11-09T02:47:09.944ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks
29762024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list
29772024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list
29782024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable
29792024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable
29802024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status
29812024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp
29822024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp
29832024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp
29842024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set
29852024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set
29862024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set}
29872024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement
29882024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported
29892024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history
29902024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4
29912024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status
29922024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address
29932024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address
29942024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask}
29952024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings
29962024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings
29972024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings
29982024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port}
29992024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy
30002024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy
30012024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles
30022024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name}
30032024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas
30042024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos
30052024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos
30062024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo}
30072024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}
30082024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools
30092024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy
30102024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy
30112024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas
30122024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas
30132024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository
30142024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version}
30152024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users
30162024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id}
30172024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin
30182024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user}
30192024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos
30202024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo}
30212024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query
30222024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/timeseries/schema
30232024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users
30242024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization
30252024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules
30262024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules
30272024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes
30282024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes
30292024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route}
30302024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route}
30312024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route}
30322024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers
30332024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers
30342024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router}
30352024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router}
30362024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router}
30372024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets
30382024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets
30392024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet}
30402024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}
30412024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet}
30422024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces
30432024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs
30442024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs
30452024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc}
30462024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc}
30472024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc}
30482024-11-09T02:47:09.945ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:12228
30492024-11-09T02:47:09.945ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
30502024-11-09T02:47:09.946ZDEBGnexus (nexus-producer-server): registered DTrace probes
30512024-11-09T02:47:09.948ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:33295 method = GET path = /{producer_id}
30522024-11-09T02:47:09.949ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:197 local_addr = [fd00:1122:3344:101::c]:33295
30532024-11-09T02:47:09.949ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:33295
30542024-11-09T02:47:09.949ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:33295
30552024-11-09T02:47:09.949ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
30562024-11-09T02:47:09.949ZDEBGnexus (nexus-producer-server): starting producer registration task
30572024-11-09T02:47:09.950ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:33295 file = oximeter/producer/src/lib.rs:283 interval = 10s producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
30582024-11-09T02:47:09.950ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
30592024-11-09T02:47:09.950ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
30602024-11-09T02:47:09.981ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
30612024-11-09T02:47:09.981ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:63669
30622024-11-09T02:47:09.981ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63669 req_id = 77031318-4261-4a1d-b87f-39a2aadaac90 roles = RoleSet { roles: {} } uri = /metrics/producers
30632024-11-09T02:47:09.982ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63669 req_id = 77031318-4261-4a1d-b87f-39a2aadaac90 resource = Database result = Ok(()) uri = /metrics/producers
30642024-11-09T02:47:09.990ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
30652024-11-09T02:47:09.990ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 8764 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:63669 req_id = 77031318-4261-4a1d-b87f-39a2aadaac90 response_code = 201 uri = /metrics/producers
30662024-11-09T02:47:09.990ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "77031318-4261-4a1d-b87f-39a2aadaac90", "content-length": "41", "date": "Sat, 09 Nov 2024 02:47:09 GMT"} })
30672024-11-09T02:47:09.991ZDEBGnexus (producer-registration-task): registered with nexus successfully
30682024-11-09T02:47:09.991ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
30692024-11-09T02:47:10.758ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" } server_name = recovery.sys.oxide.test silo_id = 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd
30702024-11-09T02:47:10.765ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:39946
30712024-11-09T02:47:10.773ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30722024-11-09T02:47:10.774ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30732024-11-09T02:47:10.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30742024-11-09T02:47:10.778ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30752024-11-09T02:47:10.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30762024-11-09T02:47:10.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30772024-11-09T02:47:10.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30782024-11-09T02:47:10.782ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") } result = Ok(())
30792024-11-09T02:47:10.782ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30802024-11-09T02:47:10.783ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30812024-11-09T02:47:10.784ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30822024-11-09T02:47:10.784ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30832024-11-09T02:47:10.786ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30842024-11-09T02:47:10.789ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") } result = Ok(())
30852024-11-09T02:47:10.789ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30862024-11-09T02:47:10.789ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30872024-11-09T02:47:10.791ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30882024-11-09T02:47:10.791ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30892024-11-09T02:47:10.792ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30902024-11-09T02:47:10.793ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30912024-11-09T02:47:10.794ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30922024-11-09T02:47:10.795ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ByName("recovery") } result = Ok(())
30932024-11-09T02:47:10.795ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30942024-11-09T02:47:10.795ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30952024-11-09T02:47:11.500ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30962024-11-09T02:47:11.500ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30972024-11-09T02:47:11.503ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30982024-11-09T02:47:11.503ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30992024-11-09T02:47:11.504ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31002024-11-09T02:47:11.505ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31012024-11-09T02:47:11.507ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31022024-11-09T02:47:11.507ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31032024-11-09T02:47:11.508ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31042024-11-09T02:47:11.509ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
31052024-11-09T02:47:11.509ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31062024-11-09T02:47:11.510ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31072024-11-09T02:47:11.511ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31082024-11-09T02:47:11.513ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
31092024-11-09T02:47:11.513ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31102024-11-09T02:47:11.513ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31112024-11-09T02:47:11.531ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 761626 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:39946 req_id = a0217bbb-9df2-492c-819d-b09ffc5b9e77 response_code = 204 uri = /v1/login/recovery/local
31122024-11-09T02:47:11.572ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" } server_name = recovery.sys.oxide.test silo_id = 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd
31132024-11-09T02:47:11.577ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = 172.30.2.7:443 remote_addr = 10.151.1.100:44449
31142024-11-09T02:47:11.579ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31152024-11-09T02:47:11.579ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31162024-11-09T02:47:11.581ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31172024-11-09T02:47:11.581ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31182024-11-09T02:47:11.583ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31192024-11-09T02:47:11.584ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
31202024-11-09T02:47:11.584ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31212024-11-09T02:47:11.584ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31222024-11-09T02:47:11.595ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31232024-11-09T02:47:11.595ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31242024-11-09T02:47:11.597ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31252024-11-09T02:47:11.597ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31262024-11-09T02:47:11.599ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31272024-11-09T02:47:11.599ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31282024-11-09T02:47:11.600ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31292024-11-09T02:47:11.601ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
31302024-11-09T02:47:11.601ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31312024-11-09T02:47:11.602ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31322024-11-09T02:47:11.603ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31332024-11-09T02:47:11.604ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
31342024-11-09T02:47:11.604ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31352024-11-09T02:47:11.604ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31362024-11-09T02:47:11.618ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31372024-11-09T02:47:11.618ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31382024-11-09T02:47:11.620ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31392024-11-09T02:47:11.620ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31402024-11-09T02:47:11.622ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31412024-11-09T02:47:11.622ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31422024-11-09T02:47:11.623ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31432024-11-09T02:47:11.624ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31442024-11-09T02:47:11.625ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31452024-11-09T02:47:11.626ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
31462024-11-09T02:47:11.626ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31472024-11-09T02:47:11.626ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31482024-11-09T02:47:11.627ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31492024-11-09T02:47:11.628ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31502024-11-09T02:47:11.629ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31512024-11-09T02:47:11.629ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31522024-11-09T02:47:11.630ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31532024-11-09T02:47:11.631ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
31542024-11-09T02:47:11.631ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 roles = RoleSet { roles: {} } uri = /v1/projects
31552024-11-09T02:47:11.632ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 resource = Database result = Ok(()) uri = /v1/projects
31562024-11-09T02:47:11.635ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 roles = RoleSet { roles: {} } uri = /v1/projects
31572024-11-09T02:47:11.635ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 resource = Database result = Ok(()) uri = /v1/projects
31582024-11-09T02:47:11.649ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 roles = RoleSet { roles: {} } uri = /v1/projects
31592024-11-09T02:47:11.649ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 resource = Database result = Ok(()) uri = /v1/projects
31602024-11-09T02:47:11.660ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/projects
31612024-11-09T02:47:11.661ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(()) uri = /v1/projects
31622024-11-09T02:47:11.661ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 roles = RoleSet { roles: {} } uri = /v1/projects
31632024-11-09T02:47:11.662ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 resource = Database result = Ok(()) uri = /v1/projects
31642024-11-09T02:47:11.663ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 86132 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.1.100:44449 req_id = 68dcbdd2-54b8-48a2-95d0-b65e48b6e5c5 response_code = 200 uri = /v1/projects
31652024-11-09T02:47:11.670ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31662024-11-09T02:47:11.670ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31672024-11-09T02:47:11.672ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31682024-11-09T02:47:11.672ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31692024-11-09T02:47:11.674ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31702024-11-09T02:47:11.675ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
31712024-11-09T02:47:11.675ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31722024-11-09T02:47:11.675ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31732024-11-09T02:47:11.677ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31742024-11-09T02:47:11.677ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31752024-11-09T02:47:11.678ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31762024-11-09T02:47:11.679ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31772024-11-09T02:47:11.680ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31782024-11-09T02:47:11.680ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31792024-11-09T02:47:11.682ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31802024-11-09T02:47:11.683ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
31812024-11-09T02:47:11.683ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31822024-11-09T02:47:11.683ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31832024-11-09T02:47:11.684ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31842024-11-09T02:47:11.685ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
31852024-11-09T02:47:11.685ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31862024-11-09T02:47:11.686ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31872024-11-09T02:47:11.703ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31882024-11-09T02:47:11.703ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31892024-11-09T02:47:11.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31902024-11-09T02:47:11.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31912024-11-09T02:47:11.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31922024-11-09T02:47:11.706ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31932024-11-09T02:47:11.707ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31942024-11-09T02:47:11.707ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31952024-11-09T02:47:11.709ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31962024-11-09T02:47:11.710ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
31972024-11-09T02:47:11.710ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31982024-11-09T02:47:11.710ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31992024-11-09T02:47:11.711ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32002024-11-09T02:47:11.711ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32012024-11-09T02:47:11.712ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32022024-11-09T02:47:11.713ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32032024-11-09T02:47:11.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32042024-11-09T02:47:11.715ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
32052024-11-09T02:47:11.715ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32062024-11-09T02:47:11.715ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 resource = Database result = Ok(()) uri = /v1/system/ip-pools
32072024-11-09T02:47:11.727ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32082024-11-09T02:47:11.727ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 resource = Database result = Ok(()) uri = /v1/system/ip-pools
32092024-11-09T02:47:11.729ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools
32102024-11-09T02:47:11.731ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
32112024-11-09T02:47:11.731ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
32122024-11-09T02:47:11.731ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 resource = Database result = Ok(()) uri = /v1/system/ip-pools
32132024-11-09T02:47:11.737ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 67805 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 6a8aac3d-892e-4e5f-8eeb-c1c4db1a8bc7 response_code = 201 uri = /v1/system/ip-pools
32142024-11-09T02:47:11.744ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32152024-11-09T02:47:11.744ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32162024-11-09T02:47:11.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32172024-11-09T02:47:11.746ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32182024-11-09T02:47:11.751ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32192024-11-09T02:47:11.752ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
32202024-11-09T02:47:11.752ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32212024-11-09T02:47:11.752ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32222024-11-09T02:47:11.754ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32232024-11-09T02:47:11.754ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32242024-11-09T02:47:11.756ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32252024-11-09T02:47:11.756ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32262024-11-09T02:47:11.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32272024-11-09T02:47:11.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32282024-11-09T02:47:11.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32292024-11-09T02:47:11.761ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
32302024-11-09T02:47:11.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32312024-11-09T02:47:11.761ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32322024-11-09T02:47:11.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32332024-11-09T02:47:11.763ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
32342024-11-09T02:47:11.763ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32352024-11-09T02:47:11.763ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32362024-11-09T02:47:11.772ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32372024-11-09T02:47:11.772ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32382024-11-09T02:47:11.773ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32392024-11-09T02:47:11.774ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32402024-11-09T02:47:11.775ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32412024-11-09T02:47:11.775ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32422024-11-09T02:47:11.776ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32432024-11-09T02:47:11.777ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32442024-11-09T02:47:11.778ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32452024-11-09T02:47:11.780ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
32462024-11-09T02:47:11.780ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32472024-11-09T02:47:11.780ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32482024-11-09T02:47:11.781ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32492024-11-09T02:47:11.781ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32502024-11-09T02:47:11.783ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32512024-11-09T02:47:11.783ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32522024-11-09T02:47:11.784ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32532024-11-09T02:47:11.786ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
32542024-11-09T02:47:11.786ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32552024-11-09T02:47:11.786ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32562024-11-09T02:47:11.787ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32572024-11-09T02:47:11.788ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32582024-11-09T02:47:11.808ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32592024-11-09T02:47:11.808ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32602024-11-09T02:47:11.810ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools/default/silos
32612024-11-09T02:47:11.813ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = IpPool { parent: Fleet, key: 039ad112-f131-4c1e-a85d-54431381b81b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
32622024-11-09T02:47:11.813ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32632024-11-09T02:47:11.813ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32642024-11-09T02:47:11.815ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32652024-11-09T02:47:11.815ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32662024-11-09T02:47:11.818ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32672024-11-09T02:47:11.818ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32682024-11-09T02:47:11.820ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32692024-11-09T02:47:11.820ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32702024-11-09T02:47:11.822ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32712024-11-09T02:47:11.822ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32722024-11-09T02:47:11.824ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools/default/silos
32732024-11-09T02:47:11.826ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
32742024-11-09T02:47:11.826ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32752024-11-09T02:47:11.826ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32762024-11-09T02:47:11.828ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32772024-11-09T02:47:11.828ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32782024-11-09T02:47:11.831ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools/default/silos
32792024-11-09T02:47:11.833ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
32802024-11-09T02:47:11.833ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
32812024-11-09T02:47:11.833ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
32822024-11-09T02:47:11.887ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 143723 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 74e5af96-96ac-4871-9df1-930f20f7022d response_code = 201 uri = /v1/system/ip-pools/default/silos
32832024-11-09T02:47:11.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32842024-11-09T02:47:11.890ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32852024-11-09T02:47:11.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32862024-11-09T02:47:11.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32872024-11-09T02:47:11.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32882024-11-09T02:47:11.904ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
32892024-11-09T02:47:11.904ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32902024-11-09T02:47:11.904ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32912024-11-09T02:47:11.905ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32922024-11-09T02:47:11.906ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32932024-11-09T02:47:11.909ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32942024-11-09T02:47:11.910ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32952024-11-09T02:47:11.911ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32962024-11-09T02:47:11.911ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32972024-11-09T02:47:11.912ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32982024-11-09T02:47:11.913ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
32992024-11-09T02:47:11.913ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33002024-11-09T02:47:11.914ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33012024-11-09T02:47:11.915ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33022024-11-09T02:47:11.916ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
33032024-11-09T02:47:11.916ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33042024-11-09T02:47:11.916ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33052024-11-09T02:47:11.924ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33062024-11-09T02:47:11.924ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33072024-11-09T02:47:11.925ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33082024-11-09T02:47:11.925ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33092024-11-09T02:47:11.926ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33102024-11-09T02:47:11.927ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33112024-11-09T02:47:11.928ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33122024-11-09T02:47:11.928ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33132024-11-09T02:47:11.930ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33142024-11-09T02:47:11.931ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
33152024-11-09T02:47:11.931ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33162024-11-09T02:47:11.931ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33172024-11-09T02:47:11.932ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33182024-11-09T02:47:11.932ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33192024-11-09T02:47:11.934ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33202024-11-09T02:47:11.934ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33212024-11-09T02:47:11.935ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33222024-11-09T02:47:11.936ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
33232024-11-09T02:47:11.936ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33242024-11-09T02:47:11.936ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33252024-11-09T02:47:11.938ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33262024-11-09T02:47:11.938ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33272024-11-09T02:47:11.941ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33282024-11-09T02:47:11.941ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33292024-11-09T02:47:11.943ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
33302024-11-09T02:47:11.945ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = IpPool { parent: Fleet, key: 039ad112-f131-4c1e-a85d-54431381b81b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33312024-11-09T02:47:11.945ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33322024-11-09T02:47:11.945ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33332024-11-09T02:47:11.947ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33342024-11-09T02:47:11.948ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33352024-11-09T02:47:11.948ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33362024-11-09T02:47:11.948ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33372024-11-09T02:47:11.950ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
33382024-11-09T02:47:11.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33392024-11-09T02:47:11.953ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
33402024-11-09T02:47:11.954ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 resource = IpPool { parent: Fleet, key: 039ad112-f131-4c1e-a85d-54431381b81b, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
33412024-11-09T02:47:11.969ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 79858 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 75882f96-4ffb-4f8c-bd9e-4abb1abe7035 response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
33422024-11-09T02:47:11.974ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33432024-11-09T02:47:11.974ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33442024-11-09T02:47:11.976ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33452024-11-09T02:47:11.976ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33462024-11-09T02:47:11.977ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33472024-11-09T02:47:11.978ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
33482024-11-09T02:47:11.978ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33492024-11-09T02:47:11.979ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33502024-11-09T02:47:11.980ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33512024-11-09T02:47:11.980ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33522024-11-09T02:47:11.981ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33532024-11-09T02:47:11.982ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33542024-11-09T02:47:11.983ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33552024-11-09T02:47:11.983ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33562024-11-09T02:47:11.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33572024-11-09T02:47:11.986ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
33582024-11-09T02:47:11.986ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33592024-11-09T02:47:11.986ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33602024-11-09T02:47:11.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33612024-11-09T02:47:11.988ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
33622024-11-09T02:47:11.988ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33632024-11-09T02:47:11.988ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33642024-11-09T02:47:11.993ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33652024-11-09T02:47:11.993ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33662024-11-09T02:47:11.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33672024-11-09T02:47:11.995ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33682024-11-09T02:47:11.996ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33692024-11-09T02:47:11.996ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33702024-11-09T02:47:11.998ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33712024-11-09T02:47:11.998ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33722024-11-09T02:47:11.999ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33732024-11-09T02:47:12.000ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
33742024-11-09T02:47:12.000ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33752024-11-09T02:47:12.000ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33762024-11-09T02:47:12.002ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33772024-11-09T02:47:12.002ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33782024-11-09T02:47:12.003ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33792024-11-09T02:47:12.003ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33802024-11-09T02:47:12.005ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33812024-11-09T02:47:12.006ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
33822024-11-09T02:47:12.006ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33832024-11-09T02:47:12.006ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33842024-11-09T02:47:12.007ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33852024-11-09T02:47:12.008ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33862024-11-09T02:47:12.010ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33872024-11-09T02:47:12.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33882024-11-09T02:47:12.011ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33892024-11-09T02:47:12.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33902024-11-09T02:47:12.014ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/silos/recovery/quotas
33912024-11-09T02:47:12.015ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
33922024-11-09T02:47:12.015ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33932024-11-09T02:47:12.015ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33942024-11-09T02:47:12.018ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33952024-11-09T02:47:12.018ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33962024-11-09T02:47:12.020ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
33972024-11-09T02:47:12.021ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
33982024-11-09T02:47:12.023ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/system/silos/recovery/quotas
33992024-11-09T02:47:12.024ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
34002024-11-09T02:47:12.024ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
34012024-11-09T02:47:12.024ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
34022024-11-09T02:47:12.030ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 56272 local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.1.100:44449 req_id = 9ceea733-9a55-4d77-8681-aac53793cfcc response_code = 200 uri = /v1/system/silos/recovery/quotas
34032024-11-09T02:47:12.033ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34042024-11-09T02:47:12.033ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34052024-11-09T02:47:12.034ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34062024-11-09T02:47:12.034ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34072024-11-09T02:47:12.036ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34082024-11-09T02:47:12.037ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
34092024-11-09T02:47:12.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34102024-11-09T02:47:12.037ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34112024-11-09T02:47:12.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34122024-11-09T02:47:12.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34132024-11-09T02:47:12.039ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34142024-11-09T02:47:12.040ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34152024-11-09T02:47:12.041ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34162024-11-09T02:47:12.041ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34172024-11-09T02:47:12.042ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34182024-11-09T02:47:12.044ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
34192024-11-09T02:47:12.044ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34202024-11-09T02:47:12.044ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34212024-11-09T02:47:12.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34222024-11-09T02:47:12.046ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
34232024-11-09T02:47:12.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34242024-11-09T02:47:12.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34252024-11-09T02:47:12.052ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34262024-11-09T02:47:12.052ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34272024-11-09T02:47:12.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34282024-11-09T02:47:12.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34292024-11-09T02:47:12.055ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34302024-11-09T02:47:12.055ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34312024-11-09T02:47:12.057ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34322024-11-09T02:47:12.057ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34332024-11-09T02:47:12.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34342024-11-09T02:47:12.059ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
34352024-11-09T02:47:12.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34362024-11-09T02:47:12.060ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34372024-11-09T02:47:12.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34382024-11-09T02:47:12.061ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34392024-11-09T02:47:12.062ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34402024-11-09T02:47:12.062ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34412024-11-09T02:47:12.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34422024-11-09T02:47:12.065ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
34432024-11-09T02:47:12.065ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c roles = RoleSet { roles: {} } uri = /v1/projects
34442024-11-09T02:47:12.065ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c resource = Database result = Ok(()) uri = /v1/projects
34452024-11-09T02:47:12.067ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c roles = RoleSet { roles: {} } uri = /v1/projects
34462024-11-09T02:47:12.067ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c resource = Database result = Ok(()) uri = /v1/projects
34472024-11-09T02:47:12.070ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c roles = RoleSet { roles: {} } uri = /v1/projects
34482024-11-09T02:47:12.070ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c resource = Database result = Ok(()) uri = /v1/projects
34492024-11-09T02:47:12.072ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/projects
34502024-11-09T02:47:12.074ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(()) uri = /v1/projects
34512024-11-09T02:47:12.074ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create
34522024-11-09T02:47:12.074ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","lookup_type":{"ById":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"},"parent":null},"project_create":{"description":"","name":"proj-3cfac5b93ee"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","silo_user_id":"4296ebdf-246b-489f-8702-6b123c033494"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34532024-11-09T02:47:12.074ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create
34542024-11-09T02:47:12.112ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create
34552024-11-09T02:47:12.112ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34562024-11-09T02:47:12.112ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34572024-11-09T02:47:12.112ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34582024-11-09T02:47:12.123ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34592024-11-09T02:47:12.123ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34602024-11-09T02:47:12.134ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34612024-11-09T02:47:12.134ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34622024-11-09T02:47:12.146ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34632024-11-09T02:47:12.146ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34642024-11-09T02:47:12.149ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34652024-11-09T02:47:12.149ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34662024-11-09T02:47:12.152ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34672024-11-09T02:47:12.152ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34682024-11-09T02:47:12.154ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34692024-11-09T02:47:12.155ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34702024-11-09T02:47:12.155ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34712024-11-09T02:47:12.155ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = ProjectCreateRecord
34722024-11-09T02:47:12.166ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34732024-11-09T02:47:12.166ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "name": String("proj-3cfac5b93ee"), "time_created": String("2024-11-09T02:47:12.146417Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.146417Z")}, "rcgen": Number(1), "silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}]) node_id = 0 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34742024-11-09T02:47:12.170ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34752024-11-09T02:47:12.170ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34762024-11-09T02:47:12.174ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34772024-11-09T02:47:12.174ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7c:8eb9:5e48::/48"), "name": String("default")}}) node_id = 1 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34782024-11-09T02:47:12.182ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34792024-11-09T02:47:12.182ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34802024-11-09T02:47:12.185ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34812024-11-09T02:47:12.185ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34822024-11-09T02:47:12.188ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34832024-11-09T02:47:12.188ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34842024-11-09T02:47:12.192ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34852024-11-09T02:47:12.192ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")) node_id = 3 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34862024-11-09T02:47:12.195ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34872024-11-09T02:47:12.195ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34882024-11-09T02:47:12.198ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34892024-11-09T02:47:12.198ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c2ec8073-4977-4deb-85fe-801915528e05")) node_id = 4 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34902024-11-09T02:47:12.201ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34912024-11-09T02:47:12.201ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34922024-11-09T02:47:12.204ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34932024-11-09T02:47:12.204ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("b04fdb2a-037f-405e-a147-c960092ee38f")) node_id = 5 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34942024-11-09T02:47:12.207ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34952024-11-09T02:47:12.207ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34962024-11-09T02:47:12.210ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34972024-11-09T02:47:12.210ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("fc1779ee-7506-4aa6-95f7-97b3be8a9139")) node_id = 6 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
34982024-11-09T02:47:12.213ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
34992024-11-09T02:47:12.213ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35002024-11-09T02:47:12.216ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35012024-11-09T02:47:12.216ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("99fec10f-2122-40f3-b7c6-ba27396c0f81")) node_id = 7 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35022024-11-09T02:47:12.218ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35032024-11-09T02:47:12.218ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35042024-11-09T02:47:12.221ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35052024-11-09T02:47:12.221ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c")) node_id = 8 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35062024-11-09T02:47:12.224ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35072024-11-09T02:47:12.224ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35082024-11-09T02:47:12.228ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35092024-11-09T02:47:12.228ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35102024-11-09T02:47:12.230ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35112024-11-09T02:47:12.230ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35122024-11-09T02:47:12.232ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35132024-11-09T02:47:12.232ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35142024-11-09T02:47:12.234ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35152024-11-09T02:47:12.235ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35162024-11-09T02:47:12.237ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35172024-11-09T02:47:12.240ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35182024-11-09T02:47:12.240ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35192024-11-09T02:47:12.240ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateVpc
35202024-11-09T02:47:12.249ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35212024-11-09T02:47:12.249ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "name": String("default"), "time_created": String("2024-11-09T02:47:12.227977Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.227977Z")}, "ipv6_prefix": String("fd7c:8eb9:5e48::/48"), "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "subnet_gen": Number(1), "system_router_id": String("c2ec8073-4977-4deb-85fe-801915528e05"), "vni": Number(12896499)}]) node_id = 9 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35222024-11-09T02:47:12.259ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35232024-11-09T02:47:12.259ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35242024-11-09T02:47:12.262ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35252024-11-09T02:47:12.263ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35262024-11-09T02:47:12.265ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35272024-11-09T02:47:12.265ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35282024-11-09T02:47:12.267ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35292024-11-09T02:47:12.267ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35302024-11-09T02:47:12.270ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35312024-11-09T02:47:12.270ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35322024-11-09T02:47:12.272ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35332024-11-09T02:47:12.274ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35342024-11-09T02:47:12.274ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35352024-11-09T02:47:12.274ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateRouter
35362024-11-09T02:47:12.311ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35372024-11-09T02:47:12.311ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("c2ec8073-4977-4deb-85fe-801915528e05"), "lookup_type": Object {"ById": String("c2ec8073-4977-4deb-85fe-801915528e05")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}) node_id = 10 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35382024-11-09T02:47:12.315ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35392024-11-09T02:47:12.315ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35402024-11-09T02:47:12.319ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35412024-11-09T02:47:12.319ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35422024-11-09T02:47:12.321ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35432024-11-09T02:47:12.321ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35442024-11-09T02:47:12.323ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35452024-11-09T02:47:12.323ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35462024-11-09T02:47:12.326ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35472024-11-09T02:47:12.326ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35482024-11-09T02:47:12.328ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35492024-11-09T02:47:12.332ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: c2ec8073-4977-4deb-85fe-801915528e05, lookup_type: ById(c2ec8073-4977-4deb-85fe-801915528e05) } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35502024-11-09T02:47:12.332ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35512024-11-09T02:47:12.332ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV4Route
35522024-11-09T02:47:12.366ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35532024-11-09T02:47:12.366ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35542024-11-09T02:47:12.369ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35552024-11-09T02:47:12.369ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35562024-11-09T02:47:12.373ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35572024-11-09T02:47:12.373ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35582024-11-09T02:47:12.375ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35592024-11-09T02:47:12.375ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35602024-11-09T02:47:12.377ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35612024-11-09T02:47:12.378ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35622024-11-09T02:47:12.380ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35632024-11-09T02:47:12.380ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35642024-11-09T02:47:12.382ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35652024-11-09T02:47:12.385ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: c2ec8073-4977-4deb-85fe-801915528e05, lookup_type: ById(c2ec8073-4977-4deb-85fe-801915528e05) } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35662024-11-09T02:47:12.385ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35672024-11-09T02:47:12.386ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateV6Route
35682024-11-09T02:47:12.417ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35692024-11-09T02:47:12.417ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35702024-11-09T02:47:12.421ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35712024-11-09T02:47:12.421ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35722024-11-09T02:47:12.424ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35732024-11-09T02:47:12.424ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35742024-11-09T02:47:12.426ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35752024-11-09T02:47:12.427ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35762024-11-09T02:47:12.429ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35772024-11-09T02:47:12.429ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35782024-11-09T02:47:12.431ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35792024-11-09T02:47:12.431ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35802024-11-09T02:47:12.433ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35812024-11-09T02:47:12.436ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35822024-11-09T02:47:12.442ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35832024-11-09T02:47:12.442ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35842024-11-09T02:47:12.459ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35852024-11-09T02:47:12.459ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateSubnet
35862024-11-09T02:47:12.465ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35872024-11-09T02:47:12.465ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "lookup_type": Object {"ById": String("99fec10f-2122-40f3-b7c6-ba27396c0f81")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "name": String("default"), "time_created": String("2024-11-09T02:47:12.424533Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.424533Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7c:8eb9:5e48::/64"), "rcgen": Number(1), "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}]) node_id = 13 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35882024-11-09T02:47:12.470ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
35892024-11-09T02:47:12.470ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
35902024-11-09T02:47:12.473ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: a3d81fc7-d536-4129-9ce4-c638208877fb, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-11-09T02:47:12.473798356Z, time_modified: 2024-11-09T02:47:12.473798356Z, time_deleted: None }, vpc_id: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 34d7af7d-ac85-4858-97d2-b81b81c2fe3c, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-11-09T02:47:12.473800876Z, time_modified: 2024-11-09T02:47:12.473800876Z, time_deleted: None }, vpc_id: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 545aa9f7-bfd0-4686-8093-f99667e83893, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-11-09T02:47:12.473801626Z, time_modified: 2024-11-09T02:47:12.473801626Z, time_deleted: None }, vpc_id: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
35912024-11-09T02:47:12.473ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35922024-11-09T02:47:12.474ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35932024-11-09T02:47:12.476ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35942024-11-09T02:47:12.476ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35952024-11-09T02:47:12.479ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35962024-11-09T02:47:12.479ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35972024-11-09T02:47:12.481ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35982024-11-09T02:47:12.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
35992024-11-09T02:47:12.483ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
36002024-11-09T02:47:12.486ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
36012024-11-09T02:47:12.486ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
36022024-11-09T02:47:12.486ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcUpdateFirewall
36032024-11-09T02:47:12.544ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36042024-11-09T02:47:12.544ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("a3d81fc7-d536-4129-9ce4-c638208877fb"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-09T02:47:12.473798356Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473798356Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("34d7af7d-ac85-4858-97d2-b81b81c2fe3c"), "name": String("allow-ssh"), "time_created": String("2024-11-09T02:47:12.473800876Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473800876Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("545aa9f7-bfd0-4686-8093-f99667e83893"), "name": String("allow-icmp"), "time_created": String("2024-11-09T02:47:12.473801626Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473801626Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}]) node_id = 14 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36052024-11-09T02:47:12.548ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36062024-11-09T02:47:12.548ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36072024-11-09T02:47:12.552ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36082024-11-09T02:47:12.552ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36092024-11-09T02:47:12.555ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36102024-11-09T02:47:12.555ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36112024-11-09T02:47:12.557ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36122024-11-09T02:47:12.557ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36132024-11-09T02:47:12.559ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36142024-11-09T02:47:12.559ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36152024-11-09T02:47:12.562ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36162024-11-09T02:47:12.564ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36172024-11-09T02:47:12.564ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36182024-11-09T02:47:12.565ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36192024-11-09T02:47:12.569ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36202024-11-09T02:47:12.569ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36212024-11-09T02:47:12.572ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36222024-11-09T02:47:12.572ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36232024-11-09T02:47:12.575ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36242024-11-09T02:47:12.575ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36252024-11-09T02:47:12.578ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36262024-11-09T02:47:12.578ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36272024-11-09T02:47:12.580ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36282024-11-09T02:47:12.580ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36292024-11-09T02:47:12.583ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36302024-11-09T02:47:12.583ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36312024-11-09T02:47:12.585ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36322024-11-09T02:47:12.588ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: 226f52d3-bce9-4ac1-b025-d7db0aefcb3c, lookup_type: ById(226f52d3-bce9-4ac1-b025-d7db0aefcb3c) } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36332024-11-09T02:47:12.588ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36342024-11-09T02:47:12.588ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcCreateGateway
36352024-11-09T02:47:12.596ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36362024-11-09T02:47:12.596ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c"), "lookup_type": Object {"ById": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}) node_id = 15 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36372024-11-09T02:47:12.599ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36382024-11-09T02:47:12.599ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36392024-11-09T02:47:12.603ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36402024-11-09T02:47:12.603ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36412024-11-09T02:47:12.605ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36422024-11-09T02:47:12.605ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36432024-11-09T02:47:12.606ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36442024-11-09T02:47:12.607ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36452024-11-09T02:47:12.608ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36462024-11-09T02:47:12.608ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36472024-11-09T02:47:12.611ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36482024-11-09T02:47:12.611ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36492024-11-09T02:47:12.613ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36502024-11-09T02:47:12.613ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36512024-11-09T02:47:12.615ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36522024-11-09T02:47:12.616ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36532024-11-09T02:47:12.618ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36542024-11-09T02:47:12.621ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36552024-11-09T02:47:12.621ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36562024-11-09T02:47:12.621ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36572024-11-09T02:47:12.623ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36582024-11-09T02:47:12.623ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36592024-11-09T02:47:12.625ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36602024-11-09T02:47:12.626ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36612024-11-09T02:47:12.628ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36622024-11-09T02:47:12.628ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36632024-11-09T02:47:12.630ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36642024-11-09T02:47:12.634ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36652024-11-09T02:47:12.634ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36662024-11-09T02:47:12.634ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_node = VpcNotifySleds
36672024-11-09T02:47:12.639ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
36682024-11-09T02:47:12.639ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
36692024-11-09T02:47:12.639ZDEBGnexus: resolved 0 rules for sleds
36702024-11-09T02:47:12.665ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
36712024-11-09T02:47:12.665ZDEBGnexus: sending firewall rules to sled agents
36722024-11-09T02:47:12.665ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
36732024-11-09T02:47:12.665ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36742024-11-09T02:47:12.665ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36752024-11-09T02:47:12.669ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36762024-11-09T02:47:12.669ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36772024-11-09T02:47:12.672ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36782024-11-09T02:47:12.672ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36792024-11-09T02:47:12.675ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36802024-11-09T02:47:12.675ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36812024-11-09T02:47:12.679ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36822024-11-09T02:47:12.679ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36832024-11-09T02:47:12.682ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 49944f85-420b-407d-bbdd-5320085c2dde sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36842024-11-09T02:47:12.682ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
36852024-11-09T02:47:12.731ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
36862024-11-09T02:47:12.731ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde saga_name = project-create saga_result = SagaResult { saga_id: 49944f85-420b-407d-bbdd-5320085c2dde, saga_log: SagaLog { saga_id: 49944f85-420b-407d-bbdd-5320085c2dde, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "name": String("proj-3cfac5b93ee"), "time_created": String("2024-11-09T02:47:12.146417Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.146417Z")}, "rcgen": Number(1), "silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7c:8eb9:5e48::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")), 4: Succeeded(String("c2ec8073-4977-4deb-85fe-801915528e05")), 5: Succeeded(String("b04fdb2a-037f-405e-a147-c960092ee38f")), 6: Succeeded(String("fc1779ee-7506-4aa6-95f7-97b3be8a9139")), 7: Succeeded(String("99fec10f-2122-40f3-b7c6-ba27396c0f81")), 8: Succeeded(String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c")), 9: Succeeded(Array [Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "name": String("default"), "time_created": String("2024-11-09T02:47:12.227977Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.227977Z")}, "ipv6_prefix": String("fd7c:8eb9:5e48::/48"), "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "subnet_gen": Number(1), "system_router_id": String("c2ec8073-4977-4deb-85fe-801915528e05"), "vni": Number(12896499)}]), 10: Succeeded(Object {"key": String("c2ec8073-4977-4deb-85fe-801915528e05"), "lookup_type": Object {"ById": String("c2ec8073-4977-4deb-85fe-801915528e05")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "lookup_type": Object {"ById": String("99fec10f-2122-40f3-b7c6-ba27396c0f81")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "name": String("default"), "time_created": String("2024-11-09T02:47:12.424533Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.424533Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7c:8eb9:5e48::/64"), "rcgen": Number(1), "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("a3d81fc7-d536-4129-9ce4-c638208877fb"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-09T02:47:12.473798356Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473798356Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("34d7af7d-ac85-4858-97d2-b81b81c2fe3c"), "name": String("allow-ssh"), "time_created": String("2024-11-09T02:47:12.473800876Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473800876Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("545aa9f7-bfd0-4686-8093-f99667e83893"), "name": String("allow-icmp"), "time_created": String("2024-11-09T02:47:12.473801626Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473801626Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}]), 15: Succeeded(Object {"key": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c"), "lookup_type": Object {"ById": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c"), "default_subnet_id": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "default_v4_route_id": String("b04fdb2a-037f-405e-a147-c960092ee38f"), "default_v6_route_id": String("fc1779ee-7506-4aa6-95f7-97b3be8a9139"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("a3d81fc7-d536-4129-9ce4-c638208877fb"), "name": String("allow-internal-inbound"), "time_created": String("2024-11-09T02:47:12.473798356Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473798356Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("34d7af7d-ac85-4858-97d2-b81b81c2fe3c"), "name": String("allow-ssh"), "time_created": String("2024-11-09T02:47:12.473800876Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473800876Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("545aa9f7-bfd0-4686-8093-f99667e83893"), "name": String("allow-icmp"), "time_created": String("2024-11-09T02:47:12.473801626Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.473801626Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}], "gateway": Object {"key": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c"), "lookup_type": Object {"ById": String("226f52d3-bce9-4ac1-b025-d7db0aefcb3c")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "name": String("proj-3cfac5b93ee"), "time_created": String("2024-11-09T02:47:12.146417Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.146417Z")}, "rcgen": Number(1), "silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}], "route4": Null, "route6": Null, "router": Object {"key": String("c2ec8073-4977-4deb-85fe-801915528e05"), "lookup_type": Object {"ById": String("c2ec8073-4977-4deb-85fe-801915528e05")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "lookup_type": Object {"ById": String("99fec10f-2122-40f3-b7c6-ba27396c0f81")}, "parent": Object {"key": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("99fec10f-2122-40f3-b7c6-ba27396c0f81"), "name": String("default"), "time_created": String("2024-11-09T02:47:12.424533Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.424533Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fd7c:8eb9:5e48::/64"), "rcgen": Number(1), "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")}], "system_router_id": String("c2ec8073-4977-4deb-85fe-801915528e05"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "lookup_type": Object {"ByName": String("proj-3cfac5b93ee")}, "parent": Object {"key": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "lookup_type": Object {"ById": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fd7c:8eb9:5e48::/48"), "name": String("default")}}, "vpc_id": String("06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec")} }) }
36872024-11-09T02:47:12.731ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 698733 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 5ea5a810-153e-411d-94b1-d495b69d0e6c response_code = 201 uri = /v1/projects
36882024-11-09T02:47:12.735ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36892024-11-09T02:47:12.735ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36902024-11-09T02:47:12.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36912024-11-09T02:47:12.737ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36922024-11-09T02:47:12.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36932024-11-09T02:47:12.740ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
36942024-11-09T02:47:12.740ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36952024-11-09T02:47:12.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36962024-11-09T02:47:12.741ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36972024-11-09T02:47:12.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36982024-11-09T02:47:12.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36992024-11-09T02:47:12.743ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37002024-11-09T02:47:12.745ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37012024-11-09T02:47:12.745ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37022024-11-09T02:47:12.746ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37032024-11-09T02:47:12.748ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
37042024-11-09T02:47:12.748ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37052024-11-09T02:47:12.748ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37062024-11-09T02:47:12.749ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37072024-11-09T02:47:12.750ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
37082024-11-09T02:47:12.750ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37092024-11-09T02:47:12.751ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37102024-11-09T02:47:12.755ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37112024-11-09T02:47:12.755ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37122024-11-09T02:47:12.757ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37132024-11-09T02:47:12.757ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37142024-11-09T02:47:12.758ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37152024-11-09T02:47:12.758ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37162024-11-09T02:47:12.759ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37172024-11-09T02:47:12.760ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37182024-11-09T02:47:12.761ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37192024-11-09T02:47:12.762ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
37202024-11-09T02:47:12.762ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37212024-11-09T02:47:12.762ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37222024-11-09T02:47:12.764ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37232024-11-09T02:47:12.764ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37242024-11-09T02:47:12.765ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37252024-11-09T02:47:12.765ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37262024-11-09T02:47:12.767ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37272024-11-09T02:47:12.768ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
37282024-11-09T02:47:12.768ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37292024-11-09T02:47:12.768ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37302024-11-09T02:47:12.769ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37312024-11-09T02:47:12.769ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37322024-11-09T02:47:12.772ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37332024-11-09T02:47:12.772ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37342024-11-09T02:47:12.774ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37352024-11-09T02:47:12.774ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37362024-11-09T02:47:12.776ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37372024-11-09T02:47:12.776ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37382024-11-09T02:47:12.779ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-3cfac5b93ee
37392024-11-09T02:47:12.779ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Database result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37402024-11-09T02:47:12.781ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/disks?project=proj-3cfac5b93ee
37412024-11-09T02:47:12.783ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") } result = Ok(()) uri = /v1/disks?project=proj-3cfac5b93ee
37422024-11-09T02:47:12.783ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
37432024-11-09T02:47:12.783ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-881a4edd128","size":1073741824},"project_id":"184fa0f1-4925-45af-88ad-65c428bc6d21","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","silo_user_id":"4296ebdf-246b-489f-8702-6b123c033494"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37442024-11-09T02:47:12.783ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
37452024-11-09T02:47:12.787ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
37462024-11-09T02:47:12.787ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37472024-11-09T02:47:12.787ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37482024-11-09T02:47:12.787ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37492024-11-09T02:47:12.790ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37502024-11-09T02:47:12.790ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37512024-11-09T02:47:12.794ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37522024-11-09T02:47:12.794ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37532024-11-09T02:47:12.797ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37542024-11-09T02:47:12.797ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("58779db1-6c5f-42da-a2d5-a9de73314e9d")) node_id = 0 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37552024-11-09T02:47:12.800ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37562024-11-09T02:47:12.800ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37572024-11-09T02:47:12.803ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37582024-11-09T02:47:12.803ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("732080d1-69d5-48e2-8be6-8754178d75c7")) node_id = 1 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37592024-11-09T02:47:12.806ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37602024-11-09T02:47:12.806ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37612024-11-09T02:47:12.810ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37622024-11-09T02:47:12.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37632024-11-09T02:47:12.811ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37642024-11-09T02:47:12.811ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37652024-11-09T02:47:12.812ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37662024-11-09T02:47:12.813ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37672024-11-09T02:47:12.815ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37682024-11-09T02:47:12.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37692024-11-09T02:47:12.817ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37702024-11-09T02:47:12.817ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37712024-11-09T02:47:12.819ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37722024-11-09T02:47:12.819ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37732024-11-09T02:47:12.821ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37742024-11-09T02:47:12.824ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) } result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37752024-11-09T02:47:12.824ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37762024-11-09T02:47:12.824ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37772024-11-09T02:47:12.826ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37782024-11-09T02:47:12.826ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37792024-11-09T02:47:12.829ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37802024-11-09T02:47:12.829ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37812024-11-09T02:47:12.830ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37822024-11-09T02:47:12.830ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37832024-11-09T02:47:12.833ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37842024-11-09T02:47:12.835ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) } result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37852024-11-09T02:47:12.835ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37862024-11-09T02:47:12.835ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = CreateDiskRecord
37872024-11-09T02:47:12.871ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37882024-11-09T02:47:12.871ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-09T02:47:12.810221Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}) node_id = 2 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37892024-11-09T02:47:12.877ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37902024-11-09T02:47:12.877ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37912024-11-09T02:47:12.880ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = RegionsAlloc
37922024-11-09T02:47:12.880ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = RegionsAlloc
37932024-11-09T02:47:12.926ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 435c2cd2-2bd6-43cc-891d-385af930c2bb, time_created: 2024-11-09T02:47:07.517772Z, time_modified: 2024-11-09T02:47:07.517772Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 736f1ad3-6d18-406b-b576-5193fe8077c2, ip: Some(fd00:1122:3344:101::19), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 5c2df4be-e07c-4023-9bcb-a538bdc5e80f, time_created: 2024-11-09T02:47:12.893711Z, time_modified: 2024-11-09T02:47:12.893711Z }, dataset_id: 435c2cd2-2bd6-43cc-891d-385af930c2bb, volume_id: 732080d1-69d5-48e2-8be6-8754178d75c7, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: 9ff0f763-588f-4b83-b5e3-b5b856e94da4, time_created: 2024-11-09T02:47:07.517772Z, time_modified: 2024-11-09T02:47:07.517772Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 99589249-e847-4d9d-a74c-b1f313d5d545, ip: Some(fd00:1122:3344:101::13), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 1c5c7182-2174-4706-a5c5-80d244ec8bdc, time_created: 2024-11-09T02:47:12.893711Z, time_modified: 2024-11-09T02:47:12.893711Z }, dataset_id: 9ff0f763-588f-4b83-b5e3-b5b856e94da4, volume_id: 732080d1-69d5-48e2-8be6-8754178d75c7, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false }), (Dataset { identity: DatasetIdentity { id: c6a4db90-5649-4dbd-b94c-e7b51b493ee0, time_created: 2024-11-09T02:47:07.517772Z, time_modified: 2024-11-09T02:47:07.517772Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 31d0192b-e979-447e-9118-b71dd165c143, ip: Some(fd00:1122:3344:101::12), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 1036b13a-65e0-471f-86f1-cc5f7ff944f8, time_created: 2024-11-09T02:47:12.893711Z, time_modified: 2024-11-09T02:47:12.893711Z }, dataset_id: c6a4db90-5649-4dbd-b94c-e7b51b493ee0, volume_id: 732080d1-69d5-48e2-8be6-8754178d75c7, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false })] file = nexus/db-queries/src/db/datastore/region.rs:280 maybe_snapshot_id = None volume_id = 732080d1-69d5-48e2-8be6-8754178d75c7
37942024-11-09T02:47:12.926ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37952024-11-09T02:47:12.926ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("736f1ad3-6d18-406b-b576-5193fe8077c2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "extent_count": Number(16), "identity": Object {"id": String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("99589249-e847-4d9d-a74c-b1f313d5d545"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "extent_count": Number(16), "identity": Object {"id": String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("31d0192b-e979-447e-9118-b71dd165c143"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "extent_count": Number(16), "identity": Object {"id": String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}]]) node_id = 3 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37962024-11-09T02:47:12.930ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
37972024-11-09T02:47:12.930ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
37982024-11-09T02:47:12.934ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = SpaceAccount
37992024-11-09T02:47:12.934ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = SpaceAccount
38002024-11-09T02:47:12.957ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38012024-11-09T02:47:12.957ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38022024-11-09T02:47:12.960ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38032024-11-09T02:47:12.960ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38042024-11-09T02:47:12.964ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38052024-11-09T02:47:12.964ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38062024-11-09T02:47:12.967ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38072024-11-09T02:47:12.967ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38082024-11-09T02:47:12.984ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 296.121719ms dataset = c6a4db90-5649-4dbd-b94c-e7b51b493ee0 file = nexus/src/app/crucible.rs:230 region = 1036b13a-65e0-471f-86f1-cc5f7ff944f8 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
38092024-11-09T02:47:12.984ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 290.514234ms dataset = 9ff0f763-588f-4b83-b5e3-b5b856e94da4 file = nexus/src/app/crucible.rs:230 region = 1c5c7182-2174-4706-a5c5-80d244ec8bdc saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
38102024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
38112024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
38122024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38132024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38142024-11-09T02:47:13.008ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 132.376885ms dataset = 435c2cd2-2bd6-43cc-891d-385af930c2bb file = nexus/src/app/crucible.rs:230 region = 5c2df4be-e07c-4023-9bcb-a538bdc5e80f saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
38152024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38162024-11-09T02:47:13.008ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38172024-11-09T02:47:13.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38182024-11-09T02:47:13.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38192024-11-09T02:47:13.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38202024-11-09T02:47:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38212024-11-09T02:47:13.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38222024-11-09T02:47:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38232024-11-09T02:47:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38242024-11-09T02:47:13.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38252024-11-09T02:47:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38262024-11-09T02:47:13.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
38272024-11-09T02:47:13.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38282024-11-09T02:47:13.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38292024-11-09T02:47:13.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.774628ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38302024-11-09T02:47:13.048ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
38312024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 39.680221ms iteration = 5 status = {"enabled":false,"status":"first target blueprint","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z","time_found":"2024-11-09T02:47:13.048258658Z"}
38322024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
38332024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
38342024-11-09T02:47:13.048ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
38352024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 9.74\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
38362024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38372024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38382024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38392024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38402024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38412024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38422024-11-09T02:47:13.048ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38432024-11-09T02:47:13.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38442024-11-09T02:47:13.049ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38452024-11-09T02:47:13.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38462024-11-09T02:47:13.051ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38472024-11-09T02:47:13.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38482024-11-09T02:47:13.053ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38492024-11-09T02:47:13.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38502024-11-09T02:47:13.053ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38512024-11-09T02:47:13.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38522024-11-09T02:47:13.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38532024-11-09T02:47:13.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38542024-11-09T02:47:13.055ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38552024-11-09T02:47:13.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38562024-11-09T02:47:13.056ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38572024-11-09T02:47:13.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38582024-11-09T02:47:13.057ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38592024-11-09T02:47:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38602024-11-09T02:47:13.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38612024-11-09T02:47:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38622024-11-09T02:47:13.058ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38632024-11-09T02:47:13.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38642024-11-09T02:47:13.060ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38652024-11-09T02:47:13.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38662024-11-09T02:47:13.094ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
38672024-11-09T02:47:13.124ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
38682024-11-09T02:47:13.148ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 272.033016ms dataset = 435c2cd2-2bd6-43cc-891d-385af930c2bb file = nexus/src/app/crucible.rs:230 region = 5c2df4be-e07c-4023-9bcb-a538bdc5e80f saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create
38692024-11-09T02:47:13.156ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
38702024-11-09T02:47:13.189ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
38712024-11-09T02:47:13.221ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
38722024-11-09T02:47:13.435ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38732024-11-09T02:47:13.436ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"key\\":\\"cByh/ataYdynfUCHuiUR4novkoxCi+nZ3GReee2MI1M=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\"]}}]}")) node_id = 6 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38742024-11-09T02:47:13.441ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38752024-11-09T02:47:13.441ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38762024-11-09T02:47:13.453ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38772024-11-09T02:47:13.453ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38782024-11-09T02:47:13.457ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
38792024-11-09T02:47:13.457ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
38802024-11-09T02:47:13.461ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38812024-11-09T02:47:13.462ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38822024-11-09T02:47:13.471ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38832024-11-09T02:47:13.472ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38842024-11-09T02:47:13.473ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38852024-11-09T02:47:13.473ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38862024-11-09T02:47:13.475ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38872024-11-09T02:47:13.476ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38882024-11-09T02:47:13.478ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38892024-11-09T02:47:13.478ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38902024-11-09T02:47:13.481ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38912024-11-09T02:47:13.481ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38922024-11-09T02:47:13.483ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38932024-11-09T02:47:13.484ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38942024-11-09T02:47:13.486ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38952024-11-09T02:47:13.489ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) }, key: 58779db1-6c5f-42da-a2d5-a9de73314e9d, lookup_type: ById(58779db1-6c5f-42da-a2d5-a9de73314e9d) } result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38962024-11-09T02:47:13.489ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38972024-11-09T02:47:13.489ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38982024-11-09T02:47:13.492ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
38992024-11-09T02:47:13.492ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39002024-11-09T02:47:13.494ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39012024-11-09T02:47:13.494ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39022024-11-09T02:47:13.497ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39032024-11-09T02:47:13.497ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39042024-11-09T02:47:13.499ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39052024-11-09T02:47:13.502ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) }, key: 58779db1-6c5f-42da-a2d5-a9de73314e9d, lookup_type: ById(58779db1-6c5f-42da-a2d5-a9de73314e9d) } result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39062024-11-09T02:47:13.502ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39072024-11-09T02:47:13.502ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_node = FinalizeDiskRecord
39082024-11-09T02:47:13.516ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39092024-11-09T02:47:13.516ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
39102024-11-09T02:47:13.521ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39112024-11-09T02:47:13.521ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
39122024-11-09T02:47:13.524ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39132024-11-09T02:47:13.524ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
39142024-11-09T02:47:13.528ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39152024-11-09T02:47:13.528ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
39162024-11-09T02:47:13.538ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39172024-11-09T02:47:13.538ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad saga_name = disk-create saga_result = SagaResult { saga_id: 41efb3ef-6a49-4032-ae94-b8cab2ca46ad, saga_log: SagaLog { saga_id: 41efb3ef-6a49-4032-ae94-b8cab2ca46ad, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("58779db1-6c5f-42da-a2d5-a9de73314e9d")), 1: Succeeded(String("732080d1-69d5-48e2-8be6-8754178d75c7")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-09T02:47:12.810221Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("736f1ad3-6d18-406b-b576-5193fe8077c2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "extent_count": Number(16), "identity": Object {"id": String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("99589249-e847-4d9d-a74c-b1f313d5d545"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "extent_count": Number(16), "identity": Object {"id": String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("31d0192b-e979-447e-9118-b71dd165c143"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "extent_count": Number(16), "identity": Object {"id": String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"key\\":\\"cByh/ataYdynfUCHuiUR4novkoxCi+nZ3GReee2MI1M=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-11-09T02:47:12.810221Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::19"), "kind": String("Crucible"), "pool_id": String("736f1ad3-6d18-406b-b576-5193fe8077c2"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("435c2cd2-2bd6-43cc-891d-385af930c2bb"), "extent_count": Number(16), "identity": Object {"id": String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::13"), "kind": String("Crucible"), "pool_id": String("99589249-e847-4d9d-a74c-b1f313d5d545"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("9ff0f763-588f-4b83-b5e3-b5b856e94da4"), "extent_count": Number(16), "identity": Object {"id": String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}], Array [Object {"compression": Null, "identity": Object {"id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "time_created": String("2024-11-09T02:47:07.517772Z"), "time_modified": String("2024-11-09T02:47:07.517772Z")}, "ip": String("fd00:1122:3344:101::12"), "kind": String("Crucible"), "pool_id": String("31d0192b-e979-447e-9118-b71dd165c143"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("c6a4db90-5649-4dbd-b94c-e7b51b493ee0"), "extent_count": Number(16), "identity": Object {"id": String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), "time_created": String("2024-11-09T02:47:12.893711Z"), "time_modified": String("2024-11-09T02:47:12.893711Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}]], "disk_id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"58779db1-6c5f-42da-a2d5-a9de73314e9d\\",\\"key\\":\\"cByh/ataYdynfUCHuiUR4novkoxCi+nZ3GReee2MI1M=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::13]:19000\\",\\"[fd00:1122:3344:101::12]:19000\\",\\"[fd00:1122:3344:101::19]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")} }) }
39182024-11-09T02:47:13.538ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 803137 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = f9bfa226-aa91-422e-8c62-2f7dd5467afc response_code = 201 uri = /v1/disks?project=proj-3cfac5b93ee
39192024-11-09T02:47:13.540ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39202024-11-09T02:47:13.540ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39212024-11-09T02:47:13.542ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39222024-11-09T02:47:13.542ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39232024-11-09T02:47:13.544ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39242024-11-09T02:47:13.545ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
39252024-11-09T02:47:13.545ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39262024-11-09T02:47:13.545ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39272024-11-09T02:47:13.547ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39282024-11-09T02:47:13.547ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39292024-11-09T02:47:13.548ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39302024-11-09T02:47:13.548ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39312024-11-09T02:47:13.550ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39322024-11-09T02:47:13.550ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39332024-11-09T02:47:13.551ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39342024-11-09T02:47:13.553ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
39352024-11-09T02:47:13.553ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39362024-11-09T02:47:13.553ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39372024-11-09T02:47:13.554ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39382024-11-09T02:47:13.555ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
39392024-11-09T02:47:13.555ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39402024-11-09T02:47:13.556ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39412024-11-09T02:47:13.561ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39422024-11-09T02:47:13.561ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39432024-11-09T02:47:13.562ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39442024-11-09T02:47:13.562ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39452024-11-09T02:47:13.564ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39462024-11-09T02:47:13.564ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39472024-11-09T02:47:13.565ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39482024-11-09T02:47:13.565ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39492024-11-09T02:47:13.566ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39502024-11-09T02:47:13.568ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
39512024-11-09T02:47:13.568ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39522024-11-09T02:47:13.568ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39532024-11-09T02:47:13.569ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39542024-11-09T02:47:13.570ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39552024-11-09T02:47:13.574ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
39562024-11-09T02:47:13.574ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
39572024-11-09T02:47:13.576ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
39582024-11-09T02:47:13.577ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
39592024-11-09T02:47:13.577ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39602024-11-09T02:47:13.577ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39612024-11-09T02:47:13.579ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39622024-11-09T02:47:13.579ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39632024-11-09T02:47:13.582ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39642024-11-09T02:47:13.582ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39652024-11-09T02:47:13.585ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39662024-11-09T02:47:13.585ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39672024-11-09T02:47:13.588ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39682024-11-09T02:47:13.588ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39692024-11-09T02:47:13.590ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39702024-11-09T02:47:13.591ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39712024-11-09T02:47:13.592ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39722024-11-09T02:47:13.593ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39732024-11-09T02:47:13.595ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39742024-11-09T02:47:13.598ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 58779db1-6c5f-42da-a2d5-a9de73314e9d, lookup_type: ByName("disk-881a4edd128") } result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39752024-11-09T02:47:13.598ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39762024-11-09T02:47:13.598ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39772024-11-09T02:47:13.601ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39782024-11-09T02:47:13.601ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39792024-11-09T02:47:13.602ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39802024-11-09T02:47:13.603ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39812024-11-09T02:47:13.604ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39822024-11-09T02:47:13.604ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39832024-11-09T02:47:13.606ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39842024-11-09T02:47:13.606ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39852024-11-09T02:47:13.609ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39862024-11-09T02:47:13.609ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39872024-11-09T02:47:13.611ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39882024-11-09T02:47:13.612ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Database result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39892024-11-09T02:47:13.614ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39902024-11-09T02:47:13.618ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ById(184fa0f1-4925-45af-88ad-65c428bc6d21) }, key: 58779db1-6c5f-42da-a2d5-a9de73314e9d, lookup_type: ById(58779db1-6c5f-42da-a2d5-a9de73314e9d) } result = Ok(()) uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
39912024-11-09T02:47:13.618ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
39922024-11-09T02:47:13.618ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","silo_user_id":"4296ebdf-246b-489f-8702-6b123c033494"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"732080d1-69d5-48e2-8be6-8754178d75c7"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"58779db1-6c5f-42da-a2d5-a9de73314e9d","project_id":"184fa0f1-4925-45af-88ad-65c428bc6d21","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","silo_user_id":"4296ebdf-246b-489f-8702-6b123c033494"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"732080d1-69d5-48e2-8be6-8754178d75c7"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39932024-11-09T02:47:13.618ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
39942024-11-09T02:47:13.622ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
39952024-11-09T02:47:13.622ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39962024-11-09T02:47:13.622ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39972024-11-09T02:47:13.622ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
39982024-11-09T02:47:13.626ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
39992024-11-09T02:47:13.626ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40002024-11-09T02:47:13.632ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40012024-11-09T02:47:13.632ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40022024-11-09T02:47:13.645ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40032024-11-09T02:47:13.645ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-09T02:47:13.489108Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}) node_id = 0 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40042024-11-09T02:47:13.648ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40052024-11-09T02:47:13.648ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40062024-11-09T02:47:13.653ZDEBGnexus (SagaExecutor): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true roles = RoleSet { roles: {} } saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete saga_node = SpaceAccount
40072024-11-09T02:47:13.653ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true resource = Database result = Ok(()) saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete saga_node = SpaceAccount
40082024-11-09T02:47:13.672ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40092024-11-09T02:47:13.672ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40102024-11-09T02:47:13.675ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40112024-11-09T02:47:13.675ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40122024-11-09T02:47:13.679ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40132024-11-09T02:47:13.679ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}) node_id = 2 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40142024-11-09T02:47:13.683ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40152024-11-09T02:47:13.683ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40162024-11-09T02:47:13.687ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40172024-11-09T02:47:13.687ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40182024-11-09T02:47:13.691ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40192024-11-09T02:47:13.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40202024-11-09T02:47:13.707ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40212024-11-09T02:47:13.707ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f")]}}) node_id = 4 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40222024-11-09T02:47:13.710ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40232024-11-09T02:47:13.710ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40242024-11-09T02:47:13.713ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40252024-11-09T02:47:13.713ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40262024-11-09T02:47:13.718ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40272024-11-09T02:47:13.718ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40282024-11-09T02:47:13.759ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 83.129633ms file = nexus/src/app/crucible.rs:827 region_id = 1036b13a-65e0-471f-86f1-cc5f7ff944f8 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40292024-11-09T02:47:13.759ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 136.221737ms file = nexus/src/app/crucible.rs:827 region_id = 5c2df4be-e07c-4023-9bcb-a538bdc5e80f saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40302024-11-09T02:47:13.765ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 86.443312ms file = nexus/src/app/crucible.rs:827 region_id = 1c5c7182-2174-4706-a5c5-80d244ec8bdc saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40312024-11-09T02:47:13.849ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 1036b13a-65e0-471f-86f1-cc5f7ff944f8 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40322024-11-09T02:47:13.857ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 1c5c7182-2174-4706-a5c5-80d244ec8bdc saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40332024-11-09T02:47:13.901ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:812 region_id = 5c2df4be-e07c-4023-9bcb-a538bdc5e80f saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40342024-11-09T02:47:13.918ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40352024-11-09T02:47:13.918ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40362024-11-09T02:47:13.924ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40372024-11-09T02:47:13.924ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40382024-11-09T02:47:13.928ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40392024-11-09T02:47:13.928ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40402024-11-09T02:47:13.933ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40412024-11-09T02:47:13.933ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40422024-11-09T02:47:13.937ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40432024-11-09T02:47:13.937ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40442024-11-09T02:47:13.941ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40452024-11-09T02:47:13.941ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40462024-11-09T02:47:13.961ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40472024-11-09T02:47:13.961ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40482024-11-09T02:47:13.965ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40492024-11-09T02:47:13.965ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40502024-11-09T02:47:13.970ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40512024-11-09T02:47:13.970ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40522024-11-09T02:47:13.974ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40532024-11-09T02:47:13.974ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40542024-11-09T02:47:13.981ZINFOnexus (SagaExecutor): allocated regions for 732080d1-69d5-48e2-8be6-8754178d75c7 is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:546 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete
40552024-11-09T02:47:13.986ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40562024-11-09T02:47:13.986ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40572024-11-09T02:47:13.990ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40582024-11-09T02:47:13.990ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40592024-11-09T02:47:13.993ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40602024-11-09T02:47:13.993ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40612024-11-09T02:47:13.997ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40622024-11-09T02:47:13.997ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40632024-11-09T02:47:14.001ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40642024-11-09T02:47:14.001ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40652024-11-09T02:47:14.005ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40662024-11-09T02:47:14.005ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
40672024-11-09T02:47:14.044ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete sec_id = 0339f029-6c8d-4b23-83cc-6885965f777d
40682024-11-09T02:47:14.044ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23 saga_name = disk-delete saga_result = SagaResult { saga_id: 83a4ddad-2311-4e2c-9165-2b4c16eaaa23, saga_log: SagaLog { saga_id: 83a4ddad-2311-4e2c-9165-2b4c16eaaa23, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-09T02:47:13.489108Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("1036b13a-65e0-471f-86f1-cc5f7ff944f8"), String("1c5c7182-2174-4706-a5c5-80d244ec8bdc"), String("5c2df4be-e07c-4023-9bcb-a538bdc5e80f")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("58779db1-6c5f-42da-a2d5-a9de73314e9d"), "name": String("disk-881a4edd128"), "time_created": String("2024-11-09T02:47:12.810222Z"), "time_deleted": Null, "time_modified": String("2024-11-09T02:47:12.810222Z")}, "pantry_address": Null, "project_id": String("184fa0f1-4925-45af-88ad-65c428bc6d21"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-11-09T02:47:13.489108Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd"), "silo_user_id": String("4296ebdf-246b-489f-8702-6b123c033494")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("732080d1-69d5-48e2-8be6-8754178d75c7")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
40692024-11-09T02:47:14.044ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 503902 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = ae9636bd-6fea-4867-a446-1c50da74ed82 response_code = 204 uri = /v1/disks/disk-881a4edd128?project=proj-3cfac5b93ee
40702024-11-09T02:47:14.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40712024-11-09T02:47:14.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40722024-11-09T02:47:14.048ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40732024-11-09T02:47:14.050ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
40742024-11-09T02:47:14.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40752024-11-09T02:47:14.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40762024-11-09T02:47:14.062ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 16727 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = d9d6b7fa-fe5a-4ee7-aec2-274cb5733a90 response_code = 200 uri = /device/auth
40772024-11-09T02:47:14.065ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40782024-11-09T02:47:14.065ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40792024-11-09T02:47:14.066ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40802024-11-09T02:47:14.066ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40812024-11-09T02:47:14.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40822024-11-09T02:47:14.070ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
40832024-11-09T02:47:14.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40842024-11-09T02:47:14.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40852024-11-09T02:47:14.071ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40862024-11-09T02:47:14.071ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40872024-11-09T02:47:14.073ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40882024-11-09T02:47:14.074ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40892024-11-09T02:47:14.075ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40902024-11-09T02:47:14.075ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40912024-11-09T02:47:14.077ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40922024-11-09T02:47:14.078ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
40932024-11-09T02:47:14.078ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40942024-11-09T02:47:14.078ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40952024-11-09T02:47:14.080ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
40962024-11-09T02:47:14.081ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
40972024-11-09T02:47:14.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
40982024-11-09T02:47:14.081ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
40992024-11-09T02:47:14.087ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41002024-11-09T02:47:14.087ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41012024-11-09T02:47:14.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41022024-11-09T02:47:14.088ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41032024-11-09T02:47:14.090ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41042024-11-09T02:47:14.090ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41052024-11-09T02:47:14.092ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41062024-11-09T02:47:14.092ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41072024-11-09T02:47:14.093ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41082024-11-09T02:47:14.095ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
41092024-11-09T02:47:14.095ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41102024-11-09T02:47:14.095ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41112024-11-09T02:47:14.096ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41122024-11-09T02:47:14.096ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41132024-11-09T02:47:14.098ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41142024-11-09T02:47:14.098ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41152024-11-09T02:47:14.099ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41162024-11-09T02:47:14.100ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
41172024-11-09T02:47:14.100ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41182024-11-09T02:47:14.100ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41192024-11-09T02:47:14.109ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41202024-11-09T02:47:14.110ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41212024-11-09T02:47:14.112ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41222024-11-09T02:47:14.112ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41232024-11-09T02:47:14.115ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /device/confirm
41242024-11-09T02:47:14.116ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = DeviceAuthRequest { parent: Fleet, key: "JMZV-ZLTR", lookup_type: ByCompositeId("user_code = \\"JMZV-ZLTR\\"") } result = Ok(()) uri = /device/confirm
41252024-11-09T02:47:14.116ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41262024-11-09T02:47:14.116ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41272024-11-09T02:47:14.118ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41282024-11-09T02:47:14.118ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41292024-11-09T02:47:14.119ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41302024-11-09T02:47:14.119ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41312024-11-09T02:47:14.122ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41322024-11-09T02:47:14.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41332024-11-09T02:47:14.125ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41342024-11-09T02:47:14.125ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41352024-11-09T02:47:14.127ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /device/confirm
41362024-11-09T02:47:14.128ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(()) uri = /device/confirm
41372024-11-09T02:47:14.128ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41382024-11-09T02:47:14.128ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41392024-11-09T02:47:14.131ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41402024-11-09T02:47:14.131ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41412024-11-09T02:47:14.133ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /device/confirm
41422024-11-09T02:47:14.134ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = DeviceAuthRequest { parent: Fleet, key: "JMZV-ZLTR", lookup_type: ByCompositeId("user_code = \\"JMZV-ZLTR\\"") } result = Ok(()) uri = /device/confirm
41432024-11-09T02:47:14.134ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41442024-11-09T02:47:14.134ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41452024-11-09T02:47:14.137ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41462024-11-09T02:47:14.137ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41472024-11-09T02:47:14.139ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41482024-11-09T02:47:14.140ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41492024-11-09T02:47:14.143ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /device/confirm
41502024-11-09T02:47:14.143ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(()) uri = /device/confirm
41512024-11-09T02:47:14.143ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 roles = RoleSet { roles: {} } uri = /device/confirm
41522024-11-09T02:47:14.144ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 resource = Database result = Ok(()) uri = /device/confirm
41532024-11-09T02:47:14.168ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 103719 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = 04f66308-175a-4e4d-8523-297b7ea69e24 response_code = 204 uri = /device/confirm
41542024-11-09T02:47:14.169ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41552024-11-09T02:47:14.170ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41562024-11-09T02:47:14.179ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9795 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.1.100:44449 req_id = e4c5aebf-64eb-4e24-b994-bcc1e3654757 response_code = 200 uri = /device/token
41572024-11-09T02:47:14.182ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41582024-11-09T02:47:14.182ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41592024-11-09T02:47:14.184ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41602024-11-09T02:47:14.184ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41612024-11-09T02:47:14.186ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41622024-11-09T02:47:14.187ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
41632024-11-09T02:47:14.187ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41642024-11-09T02:47:14.187ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41652024-11-09T02:47:14.189ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41662024-11-09T02:47:14.189ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41672024-11-09T02:47:14.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41682024-11-09T02:47:14.191ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41692024-11-09T02:47:14.192ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41702024-11-09T02:47:14.192ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41712024-11-09T02:47:14.194ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41722024-11-09T02:47:14.195ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
41732024-11-09T02:47:14.195ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41742024-11-09T02:47:14.195ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41752024-11-09T02:47:14.197ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
41762024-11-09T02:47:14.198ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
41772024-11-09T02:47:14.198ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41782024-11-09T02:47:14.198ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41792024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a756766-ec1f-4d93-b3f2-e93f0b213730", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
41802024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41812024-11-09T02:47:14.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41822024-11-09T02:47:14.202ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "097b920d-78e3-4168-9ffb-88db64f3ec12", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
41832024-11-09T02:47:14.202ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41842024-11-09T02:47:14.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41852024-11-09T02:47:14.203ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41862024-11-09T02:47:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41872024-11-09T02:47:14.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41882024-11-09T02:47:14.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41892024-11-09T02:47:14.205ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41902024-11-09T02:47:14.205ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41912024-11-09T02:47:14.205ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41922024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
41932024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
41942024-11-09T02:47:14.206ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
41952024-11-09T02:47:14.207ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41962024-11-09T02:47:14.207ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41972024-11-09T02:47:14.212ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
41982024-11-09T02:47:14.213ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
41992024-11-09T02:47:14.214ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42002024-11-09T02:47:14.215ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42012024-11-09T02:47:14.216ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42022024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8896a3ec-8d0f-4e6c-817d-d93dfdef2215", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
42032024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42042024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42052024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe78eff-cf4a-43ca-9f59-7de91d02063e", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
42062024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42072024-11-09T02:47:14.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42082024-11-09T02:47:14.218ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
42092024-11-09T02:47:14.218ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42102024-11-09T02:47:14.218ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42112024-11-09T02:47:14.219ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42122024-11-09T02:47:14.219ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42132024-11-09T02:47:14.219ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42142024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42152024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42162024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42172024-11-09T02:47:14.220ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42182024-11-09T02:47:14.220ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42192024-11-09T02:47:14.221ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42202024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42212024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42222024-11-09T02:47:14.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42232024-11-09T02:47:14.222ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42242024-11-09T02:47:14.223ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
42252024-11-09T02:47:14.223ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42262024-11-09T02:47:14.223ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42272024-11-09T02:47:14.225ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42282024-11-09T02:47:14.225ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42292024-11-09T02:47:14.227ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42302024-11-09T02:47:14.227ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42312024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "18005410-219c-4317-8126-b77c73b22051", "content-length": "64", "date": "Sat, 09 Nov 2024 02:47:13 GMT"} })
42322024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42332024-11-09T02:47:14.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42342024-11-09T02:47:14.231ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42352024-11-09T02:47:14.231ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42362024-11-09T02:47:14.232ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42372024-11-09T02:47:14.233ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42382024-11-09T02:47:14.233ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42392024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
42402024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
42412024-11-09T02:47:14.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
42422024-11-09T02:47:14.236ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42432024-11-09T02:47:14.236ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42442024-11-09T02:47:14.238ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42452024-11-09T02:47:14.238ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42462024-11-09T02:47:14.241ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42472024-11-09T02:47:14.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42482024-11-09T02:47:14.242ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 1.193885323s iteration = 2 status = {"nsuccess":5}
42492024-11-09T02:47:14.243ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42502024-11-09T02:47:14.247ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: 99fec10f-2122-40f3-b7c6-ba27396c0f81, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42512024-11-09T02:47:14.247ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42522024-11-09T02:47:14.247ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42532024-11-09T02:47:14.249ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42542024-11-09T02:47:14.249ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42552024-11-09T02:47:14.251ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42562024-11-09T02:47:14.251ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42572024-11-09T02:47:14.253ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42582024-11-09T02:47:14.253ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42592024-11-09T02:47:14.256ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42602024-11-09T02:47:14.259ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: 99fec10f-2122-40f3-b7c6-ba27396c0f81, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42612024-11-09T02:47:14.259ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42622024-11-09T02:47:14.259ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42632024-11-09T02:47:14.261ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42642024-11-09T02:47:14.262ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42652024-11-09T02:47:14.266ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42662024-11-09T02:47:14.266ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42672024-11-09T02:47:14.275ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42682024-11-09T02:47:14.276ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42692024-11-09T02:47:14.280ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 98637 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 5ac81d4b-74d2-431c-b979-72e93137bade response_code = 204 uri = /v1/vpc-subnets/default?project=proj-3cfac5b93ee&vpc=default
42702024-11-09T02:47:14.280ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Signaled
42712024-11-09T02:47:14.280ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42722024-11-09T02:47:14.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42732024-11-09T02:47:14.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42742024-11-09T02:47:14.281ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42752024-11-09T02:47:14.282ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42762024-11-09T02:47:14.282ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42772024-11-09T02:47:14.283ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42782024-11-09T02:47:14.283ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42792024-11-09T02:47:14.283ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42802024-11-09T02:47:14.283ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42812024-11-09T02:47:14.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42822024-11-09T02:47:14.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42832024-11-09T02:47:14.284ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42842024-11-09T02:47:14.286ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
42852024-11-09T02:47:14.286ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42862024-11-09T02:47:14.286ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42872024-11-09T02:47:14.287ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
42882024-11-09T02:47:14.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
42892024-11-09T02:47:14.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
42902024-11-09T02:47:14.288ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42912024-11-09T02:47:14.288ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42922024-11-09T02:47:14.289ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42932024-11-09T02:47:14.289ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42942024-11-09T02:47:14.290ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42952024-11-09T02:47:14.290ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
42962024-11-09T02:47:14.291ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
42972024-11-09T02:47:14.293ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
42982024-11-09T02:47:14.293ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
42992024-11-09T02:47:14.293ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43002024-11-09T02:47:14.294ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43012024-11-09T02:47:14.295ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
43022024-11-09T02:47:14.295ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43032024-11-09T02:47:14.295ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43042024-11-09T02:47:14.318ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
43052024-11-09T02:47:14.318ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43062024-11-09T02:47:14.319ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "cae3dbe7-0243-4f16-b814-ad685e2617b0", "content-length": "372", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
43072024-11-09T02:47:14.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43082024-11-09T02:47:14.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43092024-11-09T02:47:14.322ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43102024-11-09T02:47:14.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43112024-11-09T02:47:14.324ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43122024-11-09T02:47:14.324ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43132024-11-09T02:47:14.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43142024-11-09T02:47:14.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43152024-11-09T02:47:14.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43162024-11-09T02:47:14.327ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43172024-11-09T02:47:14.328ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43182024-11-09T02:47:14.330ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
43192024-11-09T02:47:14.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43202024-11-09T02:47:14.330ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43212024-11-09T02:47:14.331ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43222024-11-09T02:47:14.331ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43232024-11-09T02:47:14.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
43242024-11-09T02:47:14.333ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
43252024-11-09T02:47:14.334ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
43262024-11-09T02:47:14.335ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
43272024-11-09T02:47:14.335ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43282024-11-09T02:47:14.335ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43292024-11-09T02:47:14.337ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43302024-11-09T02:47:14.337ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43312024-11-09T02:47:14.339ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43322024-11-09T02:47:14.339ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43332024-11-09T02:47:14.342ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43342024-11-09T02:47:14.342ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43352024-11-09T02:47:14.344ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43362024-11-09T02:47:14.344ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43372024-11-09T02:47:14.346ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43382024-11-09T02:47:14.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43392024-11-09T02:47:14.348ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43402024-11-09T02:47:14.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43412024-11-09T02:47:14.351ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43422024-11-09T02:47:14.354ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43432024-11-09T02:47:14.354ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43442024-11-09T02:47:14.355ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43452024-11-09T02:47:14.357ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43462024-11-09T02:47:14.357ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43472024-11-09T02:47:14.360ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43482024-11-09T02:47:14.360ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43492024-11-09T02:47:14.361ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43502024-11-09T02:47:14.361ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43512024-11-09T02:47:14.364ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43522024-11-09T02:47:14.365ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
43532024-11-09T02:47:14.365ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
43542024-11-09T02:47:14.365ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c012d380-cce0-4d25-8430-4aee9825e73c", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
43552024-11-09T02:47:14.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43562024-11-09T02:47:14.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43572024-11-09T02:47:14.366ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43582024-11-09T02:47:14.367ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43592024-11-09T02:47:14.367ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43602024-11-09T02:47:14.367ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43612024-11-09T02:47:14.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43622024-11-09T02:47:14.368ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43632024-11-09T02:47:14.368ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43642024-11-09T02:47:14.370ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43652024-11-09T02:47:14.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43662024-11-09T02:47:14.372ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
43672024-11-09T02:47:14.372ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
43682024-11-09T02:47:14.373ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3efd4866-8ba6-4a2e-ae88-6117df2f6055", "date": "Sat, 09 Nov 2024 02:47:14 GMT"} })
43692024-11-09T02:47:14.373ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43702024-11-09T02:47:14.373ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43712024-11-09T02:47:14.374ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 93.669065ms iteration = 3 status = {}
43722024-11-09T02:47:14.376ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43732024-11-09T02:47:14.376ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43742024-11-09T02:47:14.378ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43752024-11-09T02:47:14.378ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43762024-11-09T02:47:14.381ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43772024-11-09T02:47:14.381ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43782024-11-09T02:47:14.383ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43792024-11-09T02:47:14.386ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") }, key: c2ec8073-4977-4deb-85fe-801915528e05, lookup_type: ById(c2ec8073-4977-4deb-85fe-801915528e05) } result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43802024-11-09T02:47:14.386ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43812024-11-09T02:47:14.386ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43822024-11-09T02:47:14.390ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43832024-11-09T02:47:14.391ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43842024-11-09T02:47:14.395ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43852024-11-09T02:47:14.395ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43862024-11-09T02:47:14.398ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43872024-11-09T02:47:14.398ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43882024-11-09T02:47:14.400ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43892024-11-09T02:47:14.400ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43902024-11-09T02:47:14.402ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43912024-11-09T02:47:14.402ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43922024-11-09T02:47:14.404ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43932024-11-09T02:47:14.404ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43942024-11-09T02:47:14.407ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43952024-11-09T02:47:14.409ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") }, key: 06d9fa8c-3cb6-4d34-a66d-f56f2ced1aec, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43962024-11-09T02:47:14.409ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43972024-11-09T02:47:14.409ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43982024-11-09T02:47:14.415ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 133804 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 1f1496d6-b439-4866-ac44-be3cb1b103e4 response_code = 204 uri = /v1/vpcs/default?project=proj-3cfac5b93ee
43992024-11-09T02:47:14.416ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44002024-11-09T02:47:14.416ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44012024-11-09T02:47:14.418ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44022024-11-09T02:47:14.418ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44032024-11-09T02:47:14.419ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44042024-11-09T02:47:14.420ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("token = \\"03cc78976a1558ab80cf7ce9b7aa3fae6e068863\\"") } result = Ok(())
44052024-11-09T02:47:14.420ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44062024-11-09T02:47:14.421ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44072024-11-09T02:47:14.422ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44082024-11-09T02:47:14.422ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44092024-11-09T02:47:14.423ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44102024-11-09T02:47:14.423ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44112024-11-09T02:47:14.425ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44122024-11-09T02:47:14.425ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44132024-11-09T02:47:14.426ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44142024-11-09T02:47:14.427ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
44152024-11-09T02:47:14.427ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44162024-11-09T02:47:14.428ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44172024-11-09T02:47:14.428ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44182024-11-09T02:47:14.430ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "03cc78976a1558ab80cf7ce9b7aa3fae6e068863", lookup_type: ByCompositeId("03cc78976a1558ab80cf7ce9b7aa3fae6e068863") } result = Ok(())
44192024-11-09T02:47:14.430ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44202024-11-09T02:47:14.430ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44212024-11-09T02:47:14.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44222024-11-09T02:47:14.434ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44232024-11-09T02:47:14.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44242024-11-09T02:47:14.435ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44252024-11-09T02:47:14.436ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44262024-11-09T02:47:14.436ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44272024-11-09T02:47:14.438ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44282024-11-09T02:47:14.438ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44292024-11-09T02:47:14.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44302024-11-09T02:47:14.440ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 4296ebdf-246b-489f-8702-6b123c033494, lookup_type: ById(4296ebdf-246b-489f-8702-6b123c033494) } result = Ok(())
44312024-11-09T02:47:14.440ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44322024-11-09T02:47:14.440ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44332024-11-09T02:47:14.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44342024-11-09T02:47:14.441ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44352024-11-09T02:47:14.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
44362024-11-09T02:47:14.443ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
44372024-11-09T02:47:14.444ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
44382024-11-09T02:47:14.445ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) } result = Ok(())
44392024-11-09T02:47:14.445ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44402024-11-09T02:47:14.445ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44412024-11-09T02:47:14.447ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44422024-11-09T02:47:14.447ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44432024-11-09T02:47:14.449ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44442024-11-09T02:47:14.449ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44452024-11-09T02:47:14.451ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44462024-11-09T02:47:14.451ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44472024-11-09T02:47:14.453ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44482024-11-09T02:47:14.453ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44492024-11-09T02:47:14.456ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44502024-11-09T02:47:14.456ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44512024-11-09T02:47:14.458ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/projects/proj-3cfac5b93ee
44522024-11-09T02:47:14.460ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") } result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44532024-11-09T02:47:14.460ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44542024-11-09T02:47:14.461ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44552024-11-09T02:47:14.462ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44562024-11-09T02:47:14.462ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44572024-11-09T02:47:14.465ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44582024-11-09T02:47:14.465ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44592024-11-09T02:47:14.467ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44602024-11-09T02:47:14.468ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44612024-11-09T02:47:14.470ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {(Silo, 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, "admin")} } uri = /v1/projects/proj-3cfac5b93ee
44622024-11-09T02:47:14.472ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 184fa0f1-4925-45af-88ad-65c428bc6d21, lookup_type: ByName("proj-3cfac5b93ee") } result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44632024-11-09T02:47:14.472ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44642024-11-09T02:47:14.472ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44652024-11-09T02:47:14.473ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44662024-11-09T02:47:14.474ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44672024-11-09T02:47:14.475ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44682024-11-09T02:47:14.476ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44692024-11-09T02:47:14.484ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44702024-11-09T02:47:14.484ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44712024-11-09T02:47:14.495ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44722024-11-09T02:47:14.495ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44732024-11-09T02:47:14.497ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44742024-11-09T02:47:14.497ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44752024-11-09T02:47:14.499ZDEBGnexus (dropshot_external): roles actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 roles = RoleSet { roles: {} } uri = /v1/projects/proj-3cfac5b93ee
44762024-11-09T02:47:14.499ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 4296ebdf-246b-489f-8702-6b123c033494, silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, .. }) actor_id = 4296ebdf-246b-489f-8702-6b123c033494 authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 resource = Database result = Ok(()) uri = /v1/projects/proj-3cfac5b93ee
44772024-11-09T02:47:14.507ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 91361 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.1.100:44449 req_id = 67172de2-d6a0-498e-a98e-dad00c2e8e98 response_code = 204 uri = /v1/projects/proj-3cfac5b93ee
44782024-11-09T02:47:20.140ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:50353
44792024-11-09T02:47:20.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d51f594d-2a6f-453e-89a2-dcdb0f2ec0f4 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
44802024-11-09T02:47:20.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d51f594d-2a6f-453e-89a2-dcdb0f2ec0f4 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
44812024-11-09T02:47:20.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3636 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d51f594d-2a6f-453e-89a2-dcdb0f2ec0f4 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
44822024-11-09T02:47:20.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6db8a958-d9c2-436e-b9eb-d799ff2d3715 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
44832024-11-09T02:47:20.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6db8a958-d9c2-436e-b9eb-d799ff2d3715 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
44842024-11-09T02:47:20.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2939 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6db8a958-d9c2-436e-b9eb-d799ff2d3715 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
44852024-11-09T02:47:20.178ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:33295 remote_addr = [fd00:1122:3344:101::d]:34571
44862024-11-09T02:47:20.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1863 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = dae0fe49-3e3b-49c9-a97f-081fd042feb2 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
44872024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
44882024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
44892024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44902024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44912024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44922024-11-09T02:47:23.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44932024-11-09T02:47:23.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44942024-11-09T02:47:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44952024-11-09T02:47:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44962024-11-09T02:47:23.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.683807ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44972024-11-09T02:47:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
44982024-11-09T02:47:23.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44992024-11-09T02:47:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45002024-11-09T02:47:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45012024-11-09T02:47:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45022024-11-09T02:47:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45032024-11-09T02:47:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
45042024-11-09T02:47:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45052024-11-09T02:47:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45062024-11-09T02:47:23.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
45072024-11-09T02:47:23.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 25.973787ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
45082024-11-09T02:47:30.180ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1434 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = d91def33-6fbc-43a6-81ff-bebcb4ddd728 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
45092024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
45102024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
45112024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
45122024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
45132024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
45142024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
45152024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
45162024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45172024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
45182024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
45192024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
45202024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
45212024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
45222024-11-09T02:47:33.009ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
45232024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
45242024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
45252024-11-09T02:47:33.009ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:37:33.009107629 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
45262024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
45272024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45282024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
45292024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
45302024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
45312024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
45322024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
45332024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
45342024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
45352024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
45362024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
45372024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45382024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
45392024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
45402024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
45412024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
45422024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
45432024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
45442024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
45452024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
45462024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
45472024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
45482024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
45492024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
45502024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45512024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
45522024-11-09T02:47:33.009ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
45532024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
45542024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.86\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
45552024-11-09T02:47:33.009ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
45562024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
45572024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
45582024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
45592024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
45602024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
45612024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 34.961\u{b5}s iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
45622024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 13.81\u{b5}s iteration = 3 status = {"errors":[],"records_set_to_done":[]}
45632024-11-09T02:47:33.009ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
45642024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
45652024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
45662024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
45672024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
45682024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.91\u{b5}s iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
45692024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
45702024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 24.511\u{b5}s iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
45712024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
45722024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
45732024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
45742024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
45752024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
45762024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45772024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
45782024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45792024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45802024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
45812024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
45822024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45832024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
45842024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
45852024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
45862024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
45872024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
45882024-11-09T02:47:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 350960741 } })
45892024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
45902024-11-09T02:47:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 351015472 } })
45912024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
45922024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
45932024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
45942024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.277817ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
45952024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
45962024-11-09T02:47:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.299067ms iteration = 3 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
45972024-11-09T02:47:33.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45982024-11-09T02:47:33.012ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
45992024-11-09T02:47:33.012ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
46002024-11-09T02:47:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
46012024-11-09T02:47:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46022024-11-09T02:47:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
46032024-11-09T02:47:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46042024-11-09T02:47:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
46052024-11-09T02:47:33.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46062024-11-09T02:47:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
46072024-11-09T02:47:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46082024-11-09T02:47:33.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46092024-11-09T02:47:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46102024-11-09T02:47:33.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 356595058 } })
46112024-11-09T02:47:33.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
46122024-11-09T02:47:33.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
46132024-11-09T02:47:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
46142024-11-09T02:47:33.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46152024-11-09T02:47:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
46162024-11-09T02:47:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46172024-11-09T02:47:33.017ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:37:33.009107629 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
46182024-11-09T02:47:33.017ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.72483ms iteration = 2 status = {"expiration":"2024-11-09T02:37:33.009107629Z","pruned":[]}
46192024-11-09T02:47:33.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46202024-11-09T02:47:33.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46212024-11-09T02:47:33.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46222024-11-09T02:47:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46232024-11-09T02:47:33.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46242024-11-09T02:47:33.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 361906947 } })
46252024-11-09T02:47:33.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
46262024-11-09T02:47:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
46272024-11-09T02:47:33.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46282024-11-09T02:47:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46292024-11-09T02:47:33.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46302024-11-09T02:47:33.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46312024-11-09T02:47:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46322024-11-09T02:47:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
46332024-11-09T02:47:33.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
46342024-11-09T02:47:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
46352024-11-09T02:47:33.023ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46362024-11-09T02:47:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
46372024-11-09T02:47:33.025ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
46382024-11-09T02:47:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
46392024-11-09T02:47:33.026ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46402024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46412024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
46422024-11-09T02:47:33.028ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
46432024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 18.608005ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
46442024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.659666ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
46452024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46462024-11-09T02:47:33.028ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46472024-11-09T02:47:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46482024-11-09T02:47:33.030ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46492024-11-09T02:47:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46502024-11-09T02:47:33.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46512024-11-09T02:47:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46522024-11-09T02:47:33.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
46532024-11-09T02:47:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
46542024-11-09T02:47:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46552024-11-09T02:47:33.036ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
46562024-11-09T02:47:33.036ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
46572024-11-09T02:47:33.036ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
46582024-11-09T02:47:33.036ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46592024-11-09T02:47:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46602024-11-09T02:47:33.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46612024-11-09T02:47:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46622024-11-09T02:47:33.038ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46632024-11-09T02:47:33.039ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 956, tv_nsec: 379897889 } })
46642024-11-09T02:47:33.039ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
46652024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
46662024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
46672024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46682024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
46692024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 31.393408ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
46702024-11-09T02:47:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46712024-11-09T02:47:33.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46722024-11-09T02:47:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46732024-11-09T02:47:33.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46742024-11-09T02:47:33.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46752024-11-09T02:47:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
46762024-11-09T02:47:33.044ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
46772024-11-09T02:47:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
46782024-11-09T02:47:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46792024-11-09T02:47:33.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46802024-11-09T02:47:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46812024-11-09T02:47:33.048ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46822024-11-09T02:47:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
46832024-11-09T02:47:33.052ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46842024-11-09T02:47:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46852024-11-09T02:47:33.054ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
46862024-11-09T02:47:33.054ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
46872024-11-09T02:47:33.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46882024-11-09T02:47:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46892024-11-09T02:47:33.054ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46902024-11-09T02:47:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46912024-11-09T02:47:33.056ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46922024-11-09T02:47:33.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46932024-11-09T02:47:33.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
46942024-11-09T02:47:33.058ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
46952024-11-09T02:47:33.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
46962024-11-09T02:47:33.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
46972024-11-09T02:47:33.059ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
46982024-11-09T02:47:33.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
46992024-11-09T02:47:33.061ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
47002024-11-09T02:47:33.061ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
47012024-11-09T02:47:33.061ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
47022024-11-09T02:47:33.061ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 52.395553ms iteration = 3 status = {"generation":2}
47032024-11-09T02:47:33.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47042024-11-09T02:47:33.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47052024-11-09T02:47:33.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47062024-11-09T02:47:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47072024-11-09T02:47:33.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47082024-11-09T02:47:33.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47092024-11-09T02:47:33.071ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47102024-11-09T02:47:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.737147ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47112024-11-09T02:47:33.071ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
47122024-11-09T02:47:33.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47132024-11-09T02:47:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47142024-11-09T02:47:33.074ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
47152024-11-09T02:47:33.074ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
47162024-11-09T02:47:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.564504ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
47172024-11-09T02:47:33.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47182024-11-09T02:47:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47192024-11-09T02:47:33.081ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
47202024-11-09T02:47:33.081ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
47212024-11-09T02:47:33.081ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
47222024-11-09T02:47:33.081ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47232024-11-09T02:47:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47242024-11-09T02:47:33.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47252024-11-09T02:47:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47262024-11-09T02:47:33.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47272024-11-09T02:47:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47282024-11-09T02:47:33.095ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47292024-11-09T02:47:33.096ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
47302024-11-09T02:47:33.096ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 86.894556ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
47312024-11-09T02:47:33.100ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
47322024-11-09T02:47:33.100ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47332024-11-09T02:47:33.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47342024-11-09T02:47:33.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47352024-11-09T02:47:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
47362024-11-09T02:47:33.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47372024-11-09T02:47:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47382024-11-09T02:47:33.109ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
47392024-11-09T02:47:33.109ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 100.249101ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
47402024-11-09T02:47:33.110ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
47412024-11-09T02:47:33.110ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
47422024-11-09T02:47:33.110ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.572699ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
47432024-11-09T02:47:33.112ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
47442024-11-09T02:47:33.112ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 103.586751ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
47452024-11-09T02:47:33.113ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 104.07061ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
47462024-11-09T02:47:33.118ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 109.154536ms iteration = 3 status = 0
47472024-11-09T02:47:33.121ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
47482024-11-09T02:47:33.121ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
47492024-11-09T02:47:33.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47502024-11-09T02:47:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47512024-11-09T02:47:33.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47522024-11-09T02:47:33.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
47532024-11-09T02:47:33.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
47542024-11-09T02:47:33.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
47552024-11-09T02:47:33.135ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
47562024-11-09T02:47:33.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 126.223168ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
47572024-11-09T02:47:33.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47582024-11-09T02:47:33.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47592024-11-09T02:47:33.158ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 149.631273ms iteration = 5 status = {"physical_disks_added":0}
47602024-11-09T02:47:33.171ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
47612024-11-09T02:47:33.171ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47622024-11-09T02:47:33.171ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28e0c6a1-fb5a-4631-8db4-23e7ba382768", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:32 GMT"} })
47632024-11-09T02:47:33.171ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47642024-11-09T02:47:33.173ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47652024-11-09T02:47:33.176ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
47662024-11-09T02:47:33.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
47672024-11-09T02:47:33.229ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47682024-11-09T02:47:33.230ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "643698ea-00c7-4982-bf6f-414959d6d126", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:32 GMT"} })
47692024-11-09T02:47:33.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47702024-11-09T02:47:33.231ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
47712024-11-09T02:47:33.308ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
47722024-11-09T02:47:33.308ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
47732024-11-09T02:47:33.308ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "66a28842-292d-4790-9e42-f1ef5de87a29", "content-length": "372", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
47742024-11-09T02:47:33.308ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47752024-11-09T02:47:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47762024-11-09T02:47:33.312ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
47772024-11-09T02:47:33.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
47782024-11-09T02:47:33.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
47792024-11-09T02:47:33.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
47802024-11-09T02:47:33.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 307.877803ms iteration = 3 status = {"generation":1}
47812024-11-09T02:47:33.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47822024-11-09T02:47:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47832024-11-09T02:47:33.323ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47842024-11-09T02:47:33.324ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
47852024-11-09T02:47:33.324ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
47862024-11-09T02:47:33.324ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c58dd3b8-2162-4876-883a-3d99fdadb712", "content-length": "26", "date": "Sat, 09 Nov 2024 02:47:32 GMT"} })
47872024-11-09T02:47:33.324ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
47882024-11-09T02:47:33.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47892024-11-09T02:47:33.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47902024-11-09T02:47:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47912024-11-09T02:47:33.326ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
47922024-11-09T02:47:33.327ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-11-09T02:47:33.329ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
47942024-11-09T02:47:33.329ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47952024-11-09T02:47:33.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47962024-11-09T02:47:33.355ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
47972024-11-09T02:47:33.356ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
47982024-11-09T02:47:33.356ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cc287aff-a4f2-4d6b-8fb6-457b32c5e4c6", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
47992024-11-09T02:47:33.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48002024-11-09T02:47:33.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48012024-11-09T02:47:33.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48022024-11-09T02:47:33.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48032024-11-09T02:47:33.369ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48042024-11-09T02:47:33.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48052024-11-09T02:47:33.373ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
48062024-11-09T02:47:33.373ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48072024-11-09T02:47:33.373ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "bcb361fd-9cf7-4c9e-8ede-b3b153d4bc83", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48082024-11-09T02:47:33.380ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 371.484547ms iteration = 4 status = {}
48092024-11-09T02:47:33.483ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
48102024-11-09T02:47:33.515ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48112024-11-09T02:47:33.515ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "437df8aa-80ae-4001-a741-da7fcd4238f1", "content-length": "1", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48122024-11-09T02:47:33.518ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48132024-11-09T02:47:33.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48142024-11-09T02:47:33.520ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 511.587612ms iteration = 3 status = null
48152024-11-09T02:47:33.528ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 518.880343ms iteration = 3 status = {}
48162024-11-09T02:47:33.600ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
48172024-11-09T02:47:33.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bd8d7bf1-2591-45a5-a24e-bd81da17996a", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48182024-11-09T02:47:33.601ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48192024-11-09T02:47:33.602ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "d4771f49-dbd4-4cfd-9cc2-cd23a722e3e6", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48202024-11-09T02:47:33.602ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48212024-11-09T02:47:33.604ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
48222024-11-09T02:47:33.604ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
48232024-11-09T02:47:33.604ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 595.194ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
48242024-11-09T02:47:33.604ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca2dd7a9-9afb-4c25-a860-25c211720e77", "content-length": "691", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48252024-11-09T02:47:33.604ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
48262024-11-09T02:47:33.604ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
48272024-11-09T02:47:33.604ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
48282024-11-09T02:47:33.605ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 596.435546ms iteration = 3 status = {}
48292024-11-09T02:47:33.612ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
48302024-11-09T02:47:33.613ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "67cc3136-c692-4f29-beb1-d76867c38344", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48312024-11-09T02:47:33.613ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48322024-11-09T02:47:33.614ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "ac5e1256-e148-4eca-b6c1-34f739b46c3e", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48332024-11-09T02:47:33.614ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48342024-11-09T02:47:33.615ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4dbffceb-49ac-4c3a-80ae-d98594877b43", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48352024-11-09T02:47:33.615ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48362024-11-09T02:47:33.617ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
48372024-11-09T02:47:33.617ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 608.024105ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
48382024-11-09T02:47:33.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48392024-11-09T02:47:33.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48402024-11-09T02:47:33.632ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
48412024-11-09T02:47:33.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48422024-11-09T02:47:33.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48432024-11-09T02:47:33.645ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48442024-11-09T02:47:33.647ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2176dde-e4c7-40fc-bb21-c1c5e975ab16", "content-length": "134", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48452024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48462024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
48472024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
48482024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
48492024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48502024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48512024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48522024-11-09T02:47:33.647ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48532024-11-09T02:47:33.648ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
48542024-11-09T02:47:33.648ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
48552024-11-09T02:47:33.649ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
48562024-11-09T02:47:33.649ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48572024-11-09T02:47:33.650ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48582024-11-09T02:47:33.658ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
48592024-11-09T02:47:33.659ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9170278d-5a15-4cbb-a785-484e9042bb47", "content-length": "2", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48602024-11-09T02:47:33.659ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
48612024-11-09T02:47:33.660ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e923fe8-0b75-43c2-837c-cf8701863900", "content-length": "52", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48622024-11-09T02:47:33.660ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
48632024-11-09T02:47:33.660ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
48642024-11-09T02:47:33.818ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fa37cd8b-87f7-417a-b8a9-24502094c2eb", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48652024-11-09T02:47:33.818ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
48662024-11-09T02:47:33.818ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48672024-11-09T02:47:33.823ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "971d57bb-d7e2-4525-8123-15d35609cde8", "content-length": "539", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48682024-11-09T02:47:33.823ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48692024-11-09T02:47:33.823ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48702024-11-09T02:47:33.836ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48712024-11-09T02:47:33.836ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48722024-11-09T02:47:33.841ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48732024-11-09T02:47:33.841ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48742024-11-09T02:47:33.844ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48752024-11-09T02:47:33.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48762024-11-09T02:47:33.846ZWARNnexus (BackgroundTasks): no bootstore config found in db background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1230 key = network_key rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
48772024-11-09T02:47:33.846ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48782024-11-09T02:47:33.846ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48792024-11-09T02:47:33.857ZINFOnexus (BackgroundTasks): updating bootstore config background_task = switch_port_config_manager config = EarlyNetworkConfig { body: EarlyNetworkConfigBody { ntp_servers: ["0.pool.ntp.org"], rack_network_config: Some(RackNetworkConfigV2 { bfd: [], bgp: [], infra_ip_first: 10.151.1.174, infra_ip_last: 10.151.1.174, ports: [PortConfigV2 { addresses: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], autoneg: false, bgp_peers: [], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", routes: [RouteConfig { destination: V4(Ipv4Net { addr: 0.0.0.0, width: 0 }), nexthop: 10.151.1.100, rib_priority: None, vlan_id: None }], switch: Switch0, tx_eq: None, uplink_port_fec: None, uplink_port_speed: Speed40G }], rack_subnet: Ipv6Net { addr: fd00:1122:3344:100::, width: 56 } }) }, generation: 2, schema_version: 2 } file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1287 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
48802024-11-09T02:47:33.858ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = PUT rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
48812024-11-09T02:47:33.862ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 204, headers: {"x-request-id": "05d9ad05-d60f-4193-b434-49ba55539dd0", "date": "Sat, 09 Nov 2024 02:47:33 GMT"} })
48822024-11-09T02:47:33.862ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48832024-11-09T02:47:33.863ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48842024-11-09T02:47:33.881ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 871.99032ms iteration = 3 status = {}
48852024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
48862024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
48872024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48882024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48892024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48902024-11-09T02:47:43.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48912024-11-09T02:47:43.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
48922024-11-09T02:47:43.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
48932024-11-09T02:47:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48942024-11-09T02:47:43.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.797399ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
48952024-11-09T02:47:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
48962024-11-09T02:47:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48972024-11-09T02:47:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48982024-11-09T02:47:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48992024-11-09T02:47:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49002024-11-09T02:47:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49012024-11-09T02:47:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
49022024-11-09T02:47:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49032024-11-09T02:47:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49042024-11-09T02:47:43.033ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
49052024-11-09T02:47:43.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.296982ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
49062024-11-09T02:47:45.157ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1015 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = a0d84215-9240-428b-8d15-d76cf188a328 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
49072024-11-09T02:47:50.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 4be97994-812f-41f7-8876-c1faf28eae4f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
49082024-11-09T02:47:50.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 4be97994-812f-41f7-8876-c1faf28eae4f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
49092024-11-09T02:47:50.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3390 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 4be97994-812f-41f7-8876-c1faf28eae4f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
49102024-11-09T02:47:50.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f811fa64-974d-43c8-a9ee-036d8d646fad roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
49112024-11-09T02:47:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f811fa64-974d-43c8-a9ee-036d8d646fad resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
49122024-11-09T02:47:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2575 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f811fa64-974d-43c8-a9ee-036d8d646fad response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
49132024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
49142024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49152024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
49162024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49172024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49182024-11-09T02:47:53.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49192024-11-09T02:47:53.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49202024-11-09T02:47:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49212024-11-09T02:47:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49222024-11-09T02:47:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49232024-11-09T02:47:53.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49242024-11-09T02:47:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49252024-11-09T02:47:53.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49262024-11-09T02:47:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
49272024-11-09T02:47:53.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49282024-11-09T02:47:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49292024-11-09T02:47:53.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
49302024-11-09T02:47:53.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.029956ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
49312024-11-09T02:47:53.038ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49322024-11-09T02:47:53.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49332024-11-09T02:47:53.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.924949ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49342024-11-09T02:48:00.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1661 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 42bec3f7-107b-4639-9a5f-9d844cc4dfe2 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
49352024-11-09T02:48:03.008ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
49362024-11-09T02:48:03.008ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49372024-11-09T02:48:03.008ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
49382024-11-09T02:48:03.008ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
49392024-11-09T02:48:03.008ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49402024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49412024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
49422024-11-09T02:48:03.009ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49432024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
49442024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
49452024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
49462024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
49472024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
49482024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
49492024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
49502024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
49512024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
49522024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
49532024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
49542024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49552024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
49562024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
49572024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
49582024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
49592024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
49602024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
49612024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49622024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49632024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
49642024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49652024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49662024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
49672024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
49682024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49692024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
49702024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49712024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
49722024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
49732024-11-09T02:48:03.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
49742024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
49752024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
49762024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.391\u{b5}s iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
49772024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
49782024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
49792024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.24\u{b5}s iteration = 4 status = {"errors":[],"records_set_to_done":[]}
49802024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 3.81\u{b5}s iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
49812024-11-09T02:48:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.85\u{b5}s iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
49822024-11-09T02:48:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49832024-11-09T02:48:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49842024-11-09T02:48:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49852024-11-09T02:48:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.060113ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
49862024-11-09T02:48:03.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49872024-11-09T02:48:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49882024-11-09T02:48:03.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 355237570 } })
49892024-11-09T02:48:03.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
49902024-11-09T02:48:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
49912024-11-09T02:48:03.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
49922024-11-09T02:48:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
49932024-11-09T02:48:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
49942024-11-09T02:48:03.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
49952024-11-09T02:48:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
49962024-11-09T02:48:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49972024-11-09T02:48:03.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49982024-11-09T02:48:03.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49992024-11-09T02:48:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50002024-11-09T02:48:03.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50012024-11-09T02:48:03.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 359613710 } })
50022024-11-09T02:48:03.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
50032024-11-09T02:48:03.019ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50042024-11-09T02:48:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50052024-11-09T02:48:03.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.14317ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
50062024-11-09T02:48:03.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50072024-11-09T02:48:03.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50082024-11-09T02:48:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50092024-11-09T02:48:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50102024-11-09T02:48:03.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50112024-11-09T02:48:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50122024-11-09T02:48:03.022ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50132024-11-09T02:48:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50142024-11-09T02:48:03.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50152024-11-09T02:48:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50162024-11-09T02:48:03.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50172024-11-09T02:48:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50182024-11-09T02:48:03.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50192024-11-09T02:48:03.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 986, tv_nsec: 365381959 } })
50202024-11-09T02:48:03.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50212024-11-09T02:48:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50222024-11-09T02:48:03.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
50232024-11-09T02:48:03.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50242024-11-09T02:48:03.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50252024-11-09T02:48:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50262024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
50272024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50282024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
50292024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50302024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50312024-11-09T02:48:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50322024-11-09T02:48:03.042ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
50332024-11-09T02:48:03.042ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 33.750937ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
50342024-11-09T02:48:03.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50352024-11-09T02:48:03.045ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50362024-11-09T02:48:03.045ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
50372024-11-09T02:48:03.045ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50382024-11-09T02:48:03.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50392024-11-09T02:48:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
50402024-11-09T02:48:03.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50412024-11-09T02:48:03.048ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 39.704831ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
50422024-11-09T02:48:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50432024-11-09T02:48:03.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50442024-11-09T02:48:03.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50452024-11-09T02:48:03.072ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
50462024-11-09T02:48:03.072ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.180405ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
50472024-11-09T02:48:03.075ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 67.034235ms iteration = 6 status = {"physical_disks_added":0}
50482024-11-09T02:48:03.083ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50492024-11-09T02:48:03.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50502024-11-09T02:48:03.086ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50512024-11-09T02:48:03.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50522024-11-09T02:48:03.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50532024-11-09T02:48:03.088ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50542024-11-09T02:48:03.088ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
50552024-11-09T02:48:03.089ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50562024-11-09T02:48:03.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50572024-11-09T02:48:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
50582024-11-09T02:48:03.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50592024-11-09T02:48:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50602024-11-09T02:48:03.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 83.664198ms iteration = 4 status = 0
50612024-11-09T02:48:03.117ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50622024-11-09T02:48:03.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50632024-11-09T02:48:03.118ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
50642024-11-09T02:48:03.118ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
50652024-11-09T02:48:03.118ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 109.749508ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
50662024-11-09T02:48:03.128ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
50672024-11-09T02:48:03.128ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50682024-11-09T02:48:03.129ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f5d4d15-4cbf-404f-a736-9b93513e7e65", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
50692024-11-09T02:48:03.129ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50702024-11-09T02:48:03.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
50712024-11-09T02:48:03.190ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
50722024-11-09T02:48:03.190ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50732024-11-09T02:48:03.190ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c5cf9f4c-bb48-4723-89e4-760d39e5d5e0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
50742024-11-09T02:48:03.190ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50752024-11-09T02:48:03.192ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50762024-11-09T02:48:03.235ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
50772024-11-09T02:48:03.235ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
50782024-11-09T02:48:03.236ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c11d441d-f079-4694-902e-4210bcffbc00", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
50792024-11-09T02:48:03.236ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
50802024-11-09T02:48:03.238ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
50812024-11-09T02:48:03.239ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
50822024-11-09T02:48:03.239ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
50832024-11-09T02:48:03.240ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d7a352e8-2a44-427b-80c3-aaa5da91d8bf", "content-length": "372", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
50842024-11-09T02:48:03.240ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50852024-11-09T02:48:03.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50862024-11-09T02:48:03.242ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50872024-11-09T02:48:03.244ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50882024-11-09T02:48:03.244ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50892024-11-09T02:48:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50902024-11-09T02:48:03.246ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50912024-11-09T02:48:03.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
50922024-11-09T02:48:03.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50932024-11-09T02:48:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50942024-11-09T02:48:03.258ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
50952024-11-09T02:48:03.258ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
50962024-11-09T02:48:03.259ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "72b9905d-76f2-4f6d-bbd9-807d32b687e1", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
50972024-11-09T02:48:03.259ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50982024-11-09T02:48:03.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50992024-11-09T02:48:03.261ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51002024-11-09T02:48:03.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51012024-11-09T02:48:03.265ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51022024-11-09T02:48:03.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51032024-11-09T02:48:03.268ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
51042024-11-09T02:48:03.268ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
51052024-11-09T02:48:03.269ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a8f2839e-8367-4042-be0e-95b5c3f5eae5", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51062024-11-09T02:48:03.271ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 262.74421ms iteration = 5 status = {}
51072024-11-09T02:48:03.309ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 300.170684ms iteration = 4 status = {}
51082024-11-09T02:48:03.332ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
51092024-11-09T02:48:03.333ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c85170e4-8a9d-4feb-baa9-ebc31fd96c49", "content-length": "1", "date": "Sat, 09 Nov 2024 02:48:02 GMT"} })
51102024-11-09T02:48:03.335ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
51112024-11-09T02:48:03.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
51122024-11-09T02:48:03.337ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 328.53997ms iteration = 4 status = null
51132024-11-09T02:48:03.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51142024-11-09T02:48:03.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51152024-11-09T02:48:03.385ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
51162024-11-09T02:48:03.385ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d86d2550-084c-40d6-8a83-ae202dc015e0", "content-length": "691", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51172024-11-09T02:48:03.385ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
51182024-11-09T02:48:03.385ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
51192024-11-09T02:48:03.385ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
51202024-11-09T02:48:03.386ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.94244ms iteration = 4 status = {}
51212024-11-09T02:48:03.387ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
51222024-11-09T02:48:03.387ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51232024-11-09T02:48:03.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51242024-11-09T02:48:03.444ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
51252024-11-09T02:48:03.444ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "07591d31-1d94-403f-8bbf-2e78342da96f", "content-length": "134", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51262024-11-09T02:48:03.444ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
51272024-11-09T02:48:03.444ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
51282024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
51292024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
51302024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51312024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51322024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51332024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51342024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
51352024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
51362024-11-09T02:48:03.445ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
51372024-11-09T02:48:03.445ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51382024-11-09T02:48:03.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51392024-11-09T02:48:03.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
51402024-11-09T02:48:03.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c337c94a-3fc7-4ab8-b05e-a7fb541d0831", "content-length": "2", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51412024-11-09T02:48:03.448ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
51422024-11-09T02:48:03.448ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "24f380e5-6612-4ee6-a026-6742db9b907c", "content-length": "52", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51432024-11-09T02:48:03.448ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
51442024-11-09T02:48:03.448ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
51452024-11-09T02:48:03.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bb6ad18a-e695-4fd8-8b2b-c08211474ffe", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51462024-11-09T02:48:03.552ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
51472024-11-09T02:48:03.552ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
51482024-11-09T02:48:03.552ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6c1b17f-fa71-4116-b358-a10e8bb64f39", "content-length": "682", "date": "Sat, 09 Nov 2024 02:48:03 GMT"} })
51492024-11-09T02:48:03.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51502024-11-09T02:48:03.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51512024-11-09T02:48:03.569ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51522024-11-09T02:48:03.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51532024-11-09T02:48:03.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51542024-11-09T02:48:03.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51552024-11-09T02:48:03.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
51562024-11-09T02:48:03.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
51572024-11-09T02:48:03.599ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.157176ms iteration = 4 status = {}
51582024-11-09T02:48:05.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 66c40545-1186-409d-894c-086fb2bdf4b8 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51592024-11-09T02:48:05.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 66c40545-1186-409d-894c-086fb2bdf4b8 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51602024-11-09T02:48:05.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3008 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 66c40545-1186-409d-894c-086fb2bdf4b8 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
51612024-11-09T02:48:05.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 3b068a85-329a-4f61-b38f-2b08c02479ca roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51622024-11-09T02:48:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 3b068a85-329a-4f61-b38f-2b08c02479ca resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51632024-11-09T02:48:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2398 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 3b068a85-329a-4f61-b38f-2b08c02479ca response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
51642024-11-09T02:48:13.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
51652024-11-09T02:48:13.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51662024-11-09T02:48:13.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
51672024-11-09T02:48:13.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51682024-11-09T02:48:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51692024-11-09T02:48:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51702024-11-09T02:48:13.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51712024-11-09T02:48:13.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51722024-11-09T02:48:13.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51732024-11-09T02:48:13.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.044763ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51742024-11-09T02:48:13.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51752024-11-09T02:48:13.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51762024-11-09T02:48:13.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51772024-11-09T02:48:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51782024-11-09T02:48:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51792024-11-09T02:48:13.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51802024-11-09T02:48:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
51812024-11-09T02:48:13.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51822024-11-09T02:48:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51832024-11-09T02:48:13.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
51842024-11-09T02:48:13.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.291541ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
51852024-11-09T02:48:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1315 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 4c48bb71-b908-44aa-b60d-a53314793938 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
51862024-11-09T02:48:23.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
51872024-11-09T02:48:23.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51882024-11-09T02:48:23.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
51892024-11-09T02:48:23.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51902024-11-09T02:48:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51912024-11-09T02:48:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51922024-11-09T02:48:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51932024-11-09T02:48:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51942024-11-09T02:48:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51952024-11-09T02:48:23.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.490063ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51962024-11-09T02:48:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
51972024-11-09T02:48:23.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51982024-11-09T02:48:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51992024-11-09T02:48:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52002024-11-09T02:48:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52012024-11-09T02:48:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52022024-11-09T02:48:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
52032024-11-09T02:48:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52042024-11-09T02:48:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52052024-11-09T02:48:23.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
52062024-11-09T02:48:23.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.039355ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
52072024-11-09T02:48:30.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1165 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 5e088fa9-3637-4f54-8742-18d79e48d78a response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
52082024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
52092024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
52102024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
52112024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52122024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
52132024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
52142024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52152024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
52162024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
52172024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
52182024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
52192024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
52202024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
52212024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
52222024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52232024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
52242024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
52252024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
52262024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52272024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
52282024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
52292024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
52302024-11-09T02:48:33.009ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
52312024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
52322024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 16.011\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
52332024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
52342024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
52352024-11-09T02:48:33.009ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
52362024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
52372024-11-09T02:48:33.009ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
52382024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52392024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
52402024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
52412024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
52422024-11-09T02:48:33.009ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:38:33.009385290 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
52432024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
52442024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
52452024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
52462024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
52472024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
52482024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
52492024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52502024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
52512024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
52522024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
52532024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
52542024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
52552024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52562024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
52572024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
52582024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52592024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
52602024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
52612024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52622024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52632024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52642024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
52652024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
52662024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52672024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
52682024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
52692024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52702024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52712024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
52722024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
52732024-11-09T02:48:33.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52742024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
52752024-11-09T02:48:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 350094923 } })
52762024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
52772024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
52782024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.25\u{b5}s iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
52792024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.24\u{b5}s iteration = 5 status = {"errors":[],"records_set_to_done":[]}
52802024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
52812024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
52822024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
52832024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.7\u{b5}s iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52842024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
52852024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
52862024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
52872024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
52882024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.96\u{b5}s iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
52892024-11-09T02:48:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 350167575 } })
52902024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
52912024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
52922024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52932024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
52942024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.104613ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
52952024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
52962024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.316647ms iteration = 4 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
52972024-11-09T02:48:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52982024-11-09T02:48:33.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52992024-11-09T02:48:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53002024-11-09T02:48:33.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53012024-11-09T02:48:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53022024-11-09T02:48:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53032024-11-09T02:48:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.855709ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
53042024-11-09T02:48:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
53052024-11-09T02:48:33.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53062024-11-09T02:48:33.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53072024-11-09T02:48:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53082024-11-09T02:48:33.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53092024-11-09T02:48:33.016ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 356891584 } })
53102024-11-09T02:48:33.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
53112024-11-09T02:48:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
53122024-11-09T02:48:33.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53132024-11-09T02:48:33.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 357373844 } })
53142024-11-09T02:48:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53152024-11-09T02:48:33.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
53162024-11-09T02:48:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53172024-11-09T02:48:33.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53182024-11-09T02:48:33.018ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53192024-11-09T02:48:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53202024-11-09T02:48:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
53212024-11-09T02:48:33.021ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
53222024-11-09T02:48:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
53232024-11-09T02:48:33.021ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:38:33.009385290 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
53242024-11-09T02:48:33.021ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 12.180222ms iteration = 3 status = {"expiration":"2024-11-09T02:38:33.009385290Z","pruned":[]}
53252024-11-09T02:48:33.021ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53262024-11-09T02:48:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53272024-11-09T02:48:33.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53282024-11-09T02:48:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53292024-11-09T02:48:33.024ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53302024-11-09T02:48:33.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53312024-11-09T02:48:33.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
53322024-11-09T02:48:33.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53332024-11-09T02:48:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53342024-11-09T02:48:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
53352024-11-09T02:48:33.028ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
53362024-11-09T02:48:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
53372024-11-09T02:48:33.030ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.035355ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
53382024-11-09T02:48:33.030ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
53392024-11-09T02:48:33.030ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
53402024-11-09T02:48:33.030ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 20.696938ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
53412024-11-09T02:48:33.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53422024-11-09T02:48:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53432024-11-09T02:48:33.036ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.047039ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53442024-11-09T02:48:33.037ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1016, tv_nsec: 377302716 } })
53452024-11-09T02:48:33.037ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
53462024-11-09T02:48:33.037ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
53472024-11-09T02:48:33.037ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
53482024-11-09T02:48:33.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53492024-11-09T02:48:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53502024-11-09T02:48:33.037ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
53512024-11-09T02:48:33.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53522024-11-09T02:48:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53532024-11-09T02:48:33.038ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53542024-11-09T02:48:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53552024-11-09T02:48:33.039ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53562024-11-09T02:48:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53572024-11-09T02:48:33.040ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
53582024-11-09T02:48:33.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53592024-11-09T02:48:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
53602024-11-09T02:48:33.041ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53612024-11-09T02:48:33.042ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
53622024-11-09T02:48:33.042ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53632024-11-09T02:48:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
53642024-11-09T02:48:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
53652024-11-09T02:48:33.044ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
53662024-11-09T02:48:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
53672024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
53682024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
53692024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
53702024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
53712024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53722024-11-09T02:48:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732024-11-09T02:48:33.055ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 46.622634ms iteration = 7 status = {"physical_disks_added":0}
53742024-11-09T02:48:33.058ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
53752024-11-09T02:48:33.058ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.297259ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
53762024-11-09T02:48:33.059ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53772024-11-09T02:48:33.062ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53782024-11-09T02:48:33.062ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53792024-11-09T02:48:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53802024-11-09T02:48:33.063ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53812024-11-09T02:48:33.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53822024-11-09T02:48:33.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53832024-11-09T02:48:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53842024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
53852024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
53862024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
53872024-11-09T02:48:33.066ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
53882024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
53892024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
53902024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
53912024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
53922024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
53932024-11-09T02:48:33.066ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
53942024-11-09T02:48:33.066ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 57.501978ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
53952024-11-09T02:48:33.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
53962024-11-09T02:48:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
53972024-11-09T02:48:33.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
53982024-11-09T02:48:33.069ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53992024-11-09T02:48:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54002024-11-09T02:48:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 61.779387ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
54012024-11-09T02:48:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
54022024-11-09T02:48:33.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54032024-11-09T02:48:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54042024-11-09T02:48:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 64.892741ms iteration = 5 status = 0
54052024-11-09T02:48:33.075ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
54062024-11-09T02:48:33.075ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
54072024-11-09T02:48:33.075ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54082024-11-09T02:48:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54092024-11-09T02:48:33.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54102024-11-09T02:48:33.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54112024-11-09T02:48:33.079ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
54122024-11-09T02:48:33.079ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 69.886684ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
54132024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
54142024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54152024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
54162024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
54172024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54182024-11-09T02:48:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
54192024-11-09T02:48:33.088ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54202024-11-09T02:48:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54212024-11-09T02:48:33.092ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
54222024-11-09T02:48:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
54232024-11-09T02:48:33.099ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
54242024-11-09T02:48:33.099ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
54252024-11-09T02:48:33.099ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
54262024-11-09T02:48:33.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54272024-11-09T02:48:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54282024-11-09T02:48:33.104ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54292024-11-09T02:48:33.104ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
54302024-11-09T02:48:33.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54312024-11-09T02:48:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54322024-11-09T02:48:33.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
54332024-11-09T02:48:33.168ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
54342024-11-09T02:48:33.171ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54352024-11-09T02:48:33.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54362024-11-09T02:48:33.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
54372024-11-09T02:48:33.225ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54382024-11-09T02:48:33.226ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "62c3b20c-233a-4eec-b6ec-6d4e85547530", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54392024-11-09T02:48:33.226ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54402024-11-09T02:48:33.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
54412024-11-09T02:48:33.273ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
54422024-11-09T02:48:33.273ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54432024-11-09T02:48:33.273ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ab0cdbf-b61b-4fb5-a937-fe432b831f3f", "content-length": "372", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54442024-11-09T02:48:33.274ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54452024-11-09T02:48:33.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54462024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
54472024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
54482024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
54492024-11-09T02:48:33.275ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 266.410545ms iteration = 4 status = {"generation":2}
54502024-11-09T02:48:33.276ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54512024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54522024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
54532024-11-09T02:48:33.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
54542024-11-09T02:48:33.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
54552024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54562024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54572024-11-09T02:48:33.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54582024-11-09T02:48:33.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54592024-11-09T02:48:33.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
54602024-11-09T02:48:33.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54612024-11-09T02:48:33.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54622024-11-09T02:48:33.323ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-11-09T02:48:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
54642024-11-09T02:48:33.327ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54652024-11-09T02:48:33.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54662024-11-09T02:48:33.329ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
54672024-11-09T02:48:33.334ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
54682024-11-09T02:48:33.334ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 325.342233ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
54692024-11-09T02:48:33.335ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
54702024-11-09T02:48:33.335ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
54712024-11-09T02:48:33.335ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 325.878295ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
54722024-11-09T02:48:33.335ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
54732024-11-09T02:48:33.335ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54742024-11-09T02:48:33.336ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "68268c73-ad53-4c41-a6d4-93eabcd6911f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54752024-11-09T02:48:33.336ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54762024-11-09T02:48:33.338ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54772024-11-09T02:48:33.343ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
54782024-11-09T02:48:33.343ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
54792024-11-09T02:48:33.343ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "334eeb96-e289-462d-b43a-be11731ccbd9", "content-length": "26", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54802024-11-09T02:48:33.343ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
54812024-11-09T02:48:33.345ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
54822024-11-09T02:48:33.356ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
54832024-11-09T02:48:33.356ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
54842024-11-09T02:48:33.356ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7d678fde-d166-4fe3-a5b1-8a94e3f2e6f9", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54852024-11-09T02:48:33.356ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54862024-11-09T02:48:33.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54872024-11-09T02:48:33.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54882024-11-09T02:48:33.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54892024-11-09T02:48:33.364ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54902024-11-09T02:48:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54912024-11-09T02:48:33.367ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
54922024-11-09T02:48:33.367ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
54932024-11-09T02:48:33.367ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ef2e2841-c6d3-49fd-a1a7-514e1116f328", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
54942024-11-09T02:48:33.369ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.212364ms iteration = 6 status = {}
54952024-11-09T02:48:33.370ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
54962024-11-09T02:48:33.370ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
54972024-11-09T02:48:33.370ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
54982024-11-09T02:48:33.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
54992024-11-09T02:48:33.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55002024-11-09T02:48:33.374ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
55012024-11-09T02:48:33.374ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b64b6c13-5ba8-4500-8386-5c21e454d5b7", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55022024-11-09T02:48:33.374ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55032024-11-09T02:48:33.375ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "beddc1d1-2b82-42b8-8ebe-e2df84ce853a", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55042024-11-09T02:48:33.375ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55052024-11-09T02:48:33.377ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
55062024-11-09T02:48:33.377ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 367.971264ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
55072024-11-09T02:48:33.377ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
55082024-11-09T02:48:33.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
55092024-11-09T02:48:33.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
55102024-11-09T02:48:33.383ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
55112024-11-09T02:48:33.383ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
55122024-11-09T02:48:33.383ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
55132024-11-09T02:48:33.383ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 374.004099ms iteration = 4 status = {"generation":1}
55142024-11-09T02:48:33.412ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
55152024-11-09T02:48:33.412ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 402.973597ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
55162024-11-09T02:48:33.504ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
55172024-11-09T02:48:33.505ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "74564a79-4432-4e1f-afb7-dc852898564c", "content-length": "691", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55182024-11-09T02:48:33.505ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
55192024-11-09T02:48:33.505ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
55202024-11-09T02:48:33.505ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
55212024-11-09T02:48:33.506ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 497.234365ms iteration = 5 status = {}
55222024-11-09T02:48:33.512ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55232024-11-09T02:48:33.512ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d96d9b40-84bc-4481-b232-723da4cbff07", "content-length": "1", "date": "Sat, 09 Nov 2024 02:48:32 GMT"} })
55242024-11-09T02:48:33.514ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55252024-11-09T02:48:33.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55262024-11-09T02:48:33.516ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 507.516268ms iteration = 5 status = null
55272024-11-09T02:48:33.578ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 569.225243ms iteration = 5 status = {}
55282024-11-09T02:48:33.578ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
55292024-11-09T02:48:33.579ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f00cce91-9000-4c36-b514-cf59cdf9dcba", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55302024-11-09T02:48:33.579ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55312024-11-09T02:48:33.581ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3ddc6e13-5c37-465d-bf51-103e98744071", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55322024-11-09T02:48:33.581ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55332024-11-09T02:48:33.582ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e4e13689-062e-4b8b-a5fc-3a2d4702afae", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55342024-11-09T02:48:33.582ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55352024-11-09T02:48:33.584ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
55362024-11-09T02:48:33.584ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 575.336179ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
55372024-11-09T02:48:33.599ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55382024-11-09T02:48:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55392024-11-09T02:48:33.602ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
55402024-11-09T02:48:33.602ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55412024-11-09T02:48:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55422024-11-09T02:48:33.612ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
55432024-11-09T02:48:33.613ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c7489c07-3be9-40aa-a138-845700b3ec55", "content-length": "134", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55442024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
55452024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
55462024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
55472024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
55482024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55492024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55502024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55512024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55522024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
55532024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
55542024-11-09T02:48:33.613ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
55552024-11-09T02:48:33.613ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55562024-11-09T02:48:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55572024-11-09T02:48:33.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
55582024-11-09T02:48:33.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "68e60f01-f589-48fe-b1c8-f71c83a1434c", "content-length": "2", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55592024-11-09T02:48:33.616ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
55602024-11-09T02:48:33.616ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "71ce94fe-7c04-407a-a89d-78dedd95f608", "content-length": "52", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55612024-11-09T02:48:33.616ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
55622024-11-09T02:48:33.616ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
55632024-11-09T02:48:33.719ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9af69a20-57e4-49c0-b572-68407146861d", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55642024-11-09T02:48:33.719ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
55652024-11-09T02:48:33.719ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
55662024-11-09T02:48:33.724ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "9c05440c-0a67-46c7-af3d-1842f0bcba72", "content-length": "682", "date": "Sat, 09 Nov 2024 02:48:33 GMT"} })
55672024-11-09T02:48:33.724ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55682024-11-09T02:48:33.724ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55692024-11-09T02:48:33.728ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55702024-11-09T02:48:33.728ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55712024-11-09T02:48:33.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55722024-11-09T02:48:33.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55732024-11-09T02:48:33.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55742024-11-09T02:48:33.734ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55752024-11-09T02:48:33.741ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 731.857274ms iteration = 5 status = {}
55762024-11-09T02:48:35.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 63baf626-56e3-43f2-b75f-260df222ba83 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55772024-11-09T02:48:35.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 63baf626-56e3-43f2-b75f-260df222ba83 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55782024-11-09T02:48:35.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3017 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 63baf626-56e3-43f2-b75f-260df222ba83 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
55792024-11-09T02:48:35.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f6838e94-9ea8-418b-9d82-20a5f68f2b2c roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55802024-11-09T02:48:35.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f6838e94-9ea8-418b-9d82-20a5f68f2b2c resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55812024-11-09T02:48:35.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2313 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = f6838e94-9ea8-418b-9d82-20a5f68f2b2c response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
55822024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
55832024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
55842024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55852024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55862024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55872024-11-09T02:48:43.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55882024-11-09T02:48:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55892024-11-09T02:48:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
55902024-11-09T02:48:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55912024-11-09T02:48:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55922024-11-09T02:48:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55932024-11-09T02:48:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55942024-11-09T02:48:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55952024-11-09T02:48:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
55962024-11-09T02:48:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55972024-11-09T02:48:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55982024-11-09T02:48:43.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
55992024-11-09T02:48:43.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.971475ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
56002024-11-09T02:48:43.038ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56012024-11-09T02:48:43.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56022024-11-09T02:48:43.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.435056ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56032024-11-09T02:48:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1106 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 0c436149-fd2e-49d9-9092-d80d0fb33844 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
56042024-11-09T02:48:50.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6224c2d9-3492-4f91-9a1d-763a3b9d42ca roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
56052024-11-09T02:48:50.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6224c2d9-3492-4f91-9a1d-763a3b9d42ca resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
56062024-11-09T02:48:50.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2962 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 6224c2d9-3492-4f91-9a1d-763a3b9d42ca response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
56072024-11-09T02:48:50.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = b94316dd-db9a-4ce4-8136-347780874374 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
56082024-11-09T02:48:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = b94316dd-db9a-4ce4-8136-347780874374 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
56092024-11-09T02:48:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2481 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = b94316dd-db9a-4ce4-8136-347780874374 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
56102024-11-09T02:48:53.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
56112024-11-09T02:48:53.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
56122024-11-09T02:48:53.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56132024-11-09T02:48:53.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56142024-11-09T02:48:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56152024-11-09T02:48:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56162024-11-09T02:48:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56172024-11-09T02:48:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56182024-11-09T02:48:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56192024-11-09T02:48:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56202024-11-09T02:48:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56212024-11-09T02:48:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56222024-11-09T02:48:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56232024-11-09T02:48:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
56242024-11-09T02:48:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56252024-11-09T02:48:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56262024-11-09T02:48:53.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
56272024-11-09T02:48:53.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.935623ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
56282024-11-09T02:48:53.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56292024-11-09T02:48:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56302024-11-09T02:48:53.067ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.377116ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56312024-11-09T02:49:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1022 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 6d610822-ba86-4003-b224-3d009be4c9d6 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
56322024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
56332024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
56342024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56352024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56362024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
56372024-11-09T02:49:03.009ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
56382024-11-09T02:49:03.009ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
56392024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56402024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
56412024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
56422024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
56432024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
56442024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
56452024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
56462024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
56472024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
56482024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
56492024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
56502024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
56512024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
56522024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
56532024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56542024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
56552024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
56562024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56572024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
56582024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
56592024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56602024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56612024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56622024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
56632024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
56642024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
56652024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
56662024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
56672024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
56682024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56692024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
56702024-11-09T02:49:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56712024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
56722024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
56732024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
56742024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.41\u{b5}s iteration = 6 status = {"errors":[],"records_set_to_done":[]}
56752024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.83\u{b5}s iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
56762024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.79\u{b5}s iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
56772024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
56782024-11-09T02:49:03.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.34\u{b5}s iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
56792024-11-09T02:49:03.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56802024-11-09T02:49:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56812024-11-09T02:49:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56822024-11-09T02:49:03.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56832024-11-09T02:49:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.568524ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
56842024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56852024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56862024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
56872024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56882024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56892024-11-09T02:49:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56902024-11-09T02:49:03.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 357639139 } })
56912024-11-09T02:49:03.018ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
56922024-11-09T02:49:03.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56932024-11-09T02:49:03.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 358614359 } })
56942024-11-09T02:49:03.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56952024-11-09T02:49:03.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56962024-11-09T02:49:03.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
56972024-11-09T02:49:03.020ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
56982024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
56992024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57002024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57012024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57022024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57032024-11-09T02:49:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57042024-11-09T02:49:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
57052024-11-09T02:49:03.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57062024-11-09T02:49:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57072024-11-09T02:49:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
57082024-11-09T02:49:03.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57092024-11-09T02:49:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57102024-11-09T02:49:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57112024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57122024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57132024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
57142024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57152024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57162024-11-09T02:49:03.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57172024-11-09T02:49:03.026ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57182024-11-09T02:49:03.026ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
57192024-11-09T02:49:03.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57202024-11-09T02:49:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57212024-11-09T02:49:03.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57222024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
57232024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57242024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57252024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57262024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57272024-11-09T02:49:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57282024-11-09T02:49:03.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1046, tv_nsec: 370178898 } })
57292024-11-09T02:49:03.030ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
57302024-11-09T02:49:03.030ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 20.515534ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
57312024-11-09T02:49:03.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
57322024-11-09T02:49:03.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57332024-11-09T02:49:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57342024-11-09T02:49:03.059ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 49.554504ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57352024-11-09T02:49:03.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57362024-11-09T02:49:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57372024-11-09T02:49:03.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57382024-11-09T02:49:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57392024-11-09T02:49:03.066ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57402024-11-09T02:49:03.067ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
57412024-11-09T02:49:03.067ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
57422024-11-09T02:49:03.067ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.555759ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
57432024-11-09T02:49:03.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
57442024-11-09T02:49:03.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57452024-11-09T02:49:03.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57462024-11-09T02:49:03.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57472024-11-09T02:49:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
57482024-11-09T02:49:03.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57492024-11-09T02:49:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57502024-11-09T02:49:03.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
57512024-11-09T02:49:03.084ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.01128ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
57522024-11-09T02:49:03.090ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.992964ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
57532024-11-09T02:49:03.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57542024-11-09T02:49:03.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
57552024-11-09T02:49:03.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57562024-11-09T02:49:03.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57572024-11-09T02:49:03.105ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 95.115066ms iteration = 6 status = 0
57582024-11-09T02:49:03.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57592024-11-09T02:49:03.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57602024-11-09T02:49:03.111ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
57612024-11-09T02:49:03.111ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57622024-11-09T02:49:03.111ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "63f438ad-27e5-4062-93d9-b2783891ffdc", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
57632024-11-09T02:49:03.111ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57642024-11-09T02:49:03.113ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57652024-11-09T02:49:03.114ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
57662024-11-09T02:49:03.114ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57672024-11-09T02:49:03.114ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "afbd76ad-0029-4e27-8913-f28c0e964084", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
57682024-11-09T02:49:03.114ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57692024-11-09T02:49:03.116ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
57702024-11-09T02:49:03.137ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
57712024-11-09T02:49:03.137ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
57722024-11-09T02:49:03.137ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e424e11b-9a7a-4da6-9e84-1ad82aeb0e22", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
57732024-11-09T02:49:03.137ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
57742024-11-09T02:49:03.139ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
57752024-11-09T02:49:03.175ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 165.324056ms iteration = 8 status = {"physical_disks_added":0}
57762024-11-09T02:49:03.205ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57772024-11-09T02:49:03.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57782024-11-09T02:49:03.207ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57792024-11-09T02:49:03.210ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57802024-11-09T02:49:03.210ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57812024-11-09T02:49:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57822024-11-09T02:49:03.212ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57832024-11-09T02:49:03.213ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
57842024-11-09T02:49:03.213ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
57852024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "24890b2d-19de-48d5-bbbb-6ee9c0924fc4", "content-length": "372", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
57862024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57872024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57882024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
57892024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57902024-11-09T02:49:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57912024-11-09T02:49:03.265ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
57922024-11-09T02:49:03.265ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6505fade-01b8-4006-bab2-9736eb4ca4e7", "content-length": "1", "date": "Sat, 09 Nov 2024 02:49:02 GMT"} })
57932024-11-09T02:49:03.267ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57942024-11-09T02:49:03.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57952024-11-09T02:49:03.269ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
57962024-11-09T02:49:03.269ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
57972024-11-09T02:49:03.269ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a25434b2-5fb1-431f-a709-ee9b874e0392", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
57982024-11-09T02:49:03.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57992024-11-09T02:49:03.270ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 260.114886ms iteration = 6 status = null
58002024-11-09T02:49:03.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58012024-11-09T02:49:03.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58022024-11-09T02:49:03.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58032024-11-09T02:49:03.276ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58042024-11-09T02:49:03.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58052024-11-09T02:49:03.281ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
58062024-11-09T02:49:03.281ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
58072024-11-09T02:49:03.281ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0341c081-78b6-4cb2-ae94-ca855c32a839", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58082024-11-09T02:49:03.283ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 273.474382ms iteration = 7 status = {}
58092024-11-09T02:49:03.327ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 317.473131ms iteration = 6 status = {}
58102024-11-09T02:49:03.333ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
58112024-11-09T02:49:03.333ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c13a14d4-563a-48a9-81d5-4abe79c00f4b", "content-length": "691", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58122024-11-09T02:49:03.333ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
58132024-11-09T02:49:03.333ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
58142024-11-09T02:49:03.333ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
58152024-11-09T02:49:03.335ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 325.574468ms iteration = 6 status = {}
58162024-11-09T02:49:03.397ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58172024-11-09T02:49:03.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58182024-11-09T02:49:03.399ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
58192024-11-09T02:49:03.399ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58202024-11-09T02:49:03.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58212024-11-09T02:49:03.409ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
58222024-11-09T02:49:03.409ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "6216535d-0bee-46c7-b99a-c7221a8c35b4", "content-length": "134", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58232024-11-09T02:49:03.409ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
58242024-11-09T02:49:03.409ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
58252024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
58262024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
58272024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58282024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58292024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58302024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58312024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
58322024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
58332024-11-09T02:49:03.410ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
58342024-11-09T02:49:03.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58352024-11-09T02:49:03.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58362024-11-09T02:49:03.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
58372024-11-09T02:49:03.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "695b9ad9-384a-482d-8d52-333c0452b0e8", "content-length": "2", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58382024-11-09T02:49:03.412ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
58392024-11-09T02:49:03.412ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3001fd2-b7dc-4689-bfbb-a82a987a3e22", "content-length": "52", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58402024-11-09T02:49:03.412ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
58412024-11-09T02:49:03.412ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
58422024-11-09T02:49:03.511ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e0ceacdd-224e-4404-a70a-1af478864435", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58432024-11-09T02:49:03.511ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
58442024-11-09T02:49:03.511ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
58452024-11-09T02:49:03.512ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "61117d59-0c3b-49a1-9101-1b7635581a31", "content-length": "682", "date": "Sat, 09 Nov 2024 02:49:03 GMT"} })
58462024-11-09T02:49:03.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58472024-11-09T02:49:03.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58482024-11-09T02:49:03.515ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58492024-11-09T02:49:03.515ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58502024-11-09T02:49:03.518ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58512024-11-09T02:49:03.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58522024-11-09T02:49:03.520ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58532024-11-09T02:49:03.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58542024-11-09T02:49:03.527ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 517.460234ms iteration = 6 status = {}
58552024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
58562024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58572024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
58582024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58592024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58602024-11-09T02:49:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58612024-11-09T02:49:13.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58622024-11-09T02:49:13.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58632024-11-09T02:49:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58642024-11-09T02:49:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58652024-11-09T02:49:13.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58662024-11-09T02:49:13.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.85215ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58672024-11-09T02:49:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58682024-11-09T02:49:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58692024-11-09T02:49:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58702024-11-09T02:49:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58712024-11-09T02:49:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
58722024-11-09T02:49:13.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58732024-11-09T02:49:13.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58742024-11-09T02:49:13.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
58752024-11-09T02:49:13.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.037174ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
58762024-11-09T02:49:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1375 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = e325c21f-eaec-4dfd-982f-0bb821e9cadb response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
58772024-11-09T02:49:16.666ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43289
58782024-11-09T02:49:16.666ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43289 req_id = 51537513-ee14-432a-a153-0b70638af60c roles = RoleSet { roles: {} } uri = /metrics/producers
58792024-11-09T02:49:16.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43289 req_id = 51537513-ee14-432a-a153-0b70638af60c resource = Database result = Ok(()) uri = /metrics/producers
58802024-11-09T02:49:16.705ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
58812024-11-09T02:49:16.705ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38964 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43289 req_id = 51537513-ee14-432a-a153-0b70638af60c response_code = 201 uri = /metrics/producers
58822024-11-09T02:49:18.367ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:63032
58832024-11-09T02:49:18.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = 33a082a6-853d-4493-90d2-70d1e062885e roles = RoleSet { roles: {} } uri = /metrics/producers
58842024-11-09T02:49:18.368ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = 33a082a6-853d-4493-90d2-70d1e062885e resource = Database result = Ok(()) uri = /metrics/producers
58852024-11-09T02:49:18.402ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
58862024-11-09T02:49:18.402ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34666 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:63032 req_id = 33a082a6-853d-4493-90d2-70d1e062885e response_code = 201 uri = /metrics/producers
58872024-11-09T02:49:20.141ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 522268d4-3f70-46d5-b91a-0f5aab625975 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
58882024-11-09T02:49:20.141ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 522268d4-3f70-46d5-b91a-0f5aab625975 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
58892024-11-09T02:49:20.143ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2703 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 522268d4-3f70-46d5-b91a-0f5aab625975 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
58902024-11-09T02:49:20.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5f495910-d5b5-4f47-8131-d79016b75460 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
58912024-11-09T02:49:20.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5f495910-d5b5-4f47-8131-d79016b75460 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
58922024-11-09T02:49:20.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2053 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5f495910-d5b5-4f47-8131-d79016b75460 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
58932024-11-09T02:49:22.298ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:38572
58942024-11-09T02:49:22.299ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38572 req_id = 1b759dc1-7716-4b31-8188-b9eb30463e85 roles = RoleSet { roles: {} } uri = /metrics/producers
58952024-11-09T02:49:22.299ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38572 req_id = 1b759dc1-7716-4b31-8188-b9eb30463e85 resource = Database result = Ok(()) uri = /metrics/producers
58962024-11-09T02:49:22.336ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
58972024-11-09T02:49:22.336ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37543 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:38572 req_id = 1b759dc1-7716-4b31-8188-b9eb30463e85 response_code = 201 uri = /metrics/producers
58982024-11-09T02:49:22.629ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52745
58992024-11-09T02:49:22.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52745 req_id = bd4dc95c-9e0b-4d0f-a340-3d3ce4fd17e8 roles = RoleSet { roles: {} } uri = /metrics/producers
59002024-11-09T02:49:22.630ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52745 req_id = bd4dc95c-9e0b-4d0f-a340-3d3ce4fd17e8 resource = Database result = Ok(()) uri = /metrics/producers
59012024-11-09T02:49:22.639ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
59022024-11-09T02:49:22.639ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9519 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52745 req_id = bd4dc95c-9e0b-4d0f-a340-3d3ce4fd17e8 response_code = 201 uri = /metrics/producers
59032024-11-09T02:49:23.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
59042024-11-09T02:49:23.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59052024-11-09T02:49:23.009ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
59062024-11-09T02:49:23.009ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59072024-11-09T02:49:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59082024-11-09T02:49:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59092024-11-09T02:49:23.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59102024-11-09T02:49:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59112024-11-09T02:49:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59122024-11-09T02:49:23.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.228678ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
59132024-11-09T02:49:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
59142024-11-09T02:49:23.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59152024-11-09T02:49:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59162024-11-09T02:49:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59172024-11-09T02:49:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59182024-11-09T02:49:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59192024-11-09T02:49:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
59202024-11-09T02:49:23.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59212024-11-09T02:49:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59222024-11-09T02:49:23.029ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
59232024-11-09T02:49:23.029ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.679087ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
59242024-11-09T02:49:27.779ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35484
59252024-11-09T02:49:27.780ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35484 req_id = cce26bfb-35e4-415e-b0bf-9d9b426a20d7 roles = RoleSet { roles: {} } uri = /metrics/producers
59262024-11-09T02:49:27.780ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35484 req_id = cce26bfb-35e4-415e-b0bf-9d9b426a20d7 resource = Database result = Ok(()) uri = /metrics/producers
59272024-11-09T02:49:27.812ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
59282024-11-09T02:49:27.812ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 32823 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35484 req_id = cce26bfb-35e4-415e-b0bf-9d9b426a20d7 response_code = 201 uri = /metrics/producers
59292024-11-09T02:49:30.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1172 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 33319eaf-5585-4ad1-a238-99fb5dbb5a38 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
59302024-11-09T02:49:31.921ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:60665
59312024-11-09T02:49:31.922ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60665 req_id = cfc537d0-cfd2-4b8f-9815-d914f41ace50 roles = RoleSet { roles: {} } uri = /metrics/producers
59322024-11-09T02:49:31.922ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60665 req_id = cfc537d0-cfd2-4b8f-9815-d914f41ace50 resource = Database result = Ok(()) uri = /metrics/producers
59332024-11-09T02:49:31.963ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
59342024-11-09T02:49:31.963ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41110 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:60665 req_id = cfc537d0-cfd2-4b8f-9815-d914f41ace50 response_code = 201 uri = /metrics/producers
59352024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
59362024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
59372024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
59382024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
59392024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59402024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
59412024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
59422024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59432024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
59442024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
59452024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
59462024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
59472024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59482024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
59492024-11-09T02:49:33.009ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
59502024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
59512024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
59522024-11-09T02:49:33.009ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
59532024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
59542024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59552024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
59562024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
59572024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
59582024-11-09T02:49:33.010ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
59592024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.03\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
59602024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
59612024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
59622024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59632024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
59642024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
59652024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
59662024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
59672024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
59682024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59692024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
59702024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
59712024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
59722024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59732024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59742024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
59752024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59762024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
59772024-11-09T02:49:33.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
59782024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
59792024-11-09T02:49:33.010ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:39:33.010134226 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
59802024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
59812024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59822024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
59832024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
59842024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59852024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
59862024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
59872024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59882024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59892024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59902024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
59912024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59922024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
59932024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
59942024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
59952024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
59962024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59972024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
59982024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59992024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60002024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
60012024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
60022024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
60032024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
60042024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
60052024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 6.72\u{b5}s iteration = 7 status = {"errors":[],"records_set_to_done":[]}
60062024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60072024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.31\u{b5}s iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60082024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
60092024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.99\u{b5}s iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
60102024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
60112024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
60122024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 27.071\u{b5}s iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
60132024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60142024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60152024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60162024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
60172024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60182024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60192024-11-09T02:49:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 350420340 } })
60202024-11-09T02:49:33.010ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 350424610 } })
60212024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
60222024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60232024-11-09T02:49:33.010ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60242024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
60252024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60262024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60272024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
60282024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60292024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60302024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.49328ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
60312024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
60322024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.44403ms iteration = 5 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
60332024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60342024-11-09T02:49:33.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60352024-11-09T02:49:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60362024-11-09T02:49:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60372024-11-09T02:49:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60382024-11-09T02:49:33.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60392024-11-09T02:49:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.417001ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
60402024-11-09T02:49:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
60412024-11-09T02:49:33.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60422024-11-09T02:49:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60432024-11-09T02:49:33.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 359820554 } })
60442024-11-09T02:49:33.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
60452024-11-09T02:49:33.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60462024-11-09T02:49:33.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60472024-11-09T02:49:33.022ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60482024-11-09T02:49:33.023ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:39:33.010134226 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
60492024-11-09T02:49:33.023ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.394936ms iteration = 4 status = {"expiration":"2024-11-09T02:39:33.010134226Z","pruned":[]}
60502024-11-09T02:49:33.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60512024-11-09T02:49:33.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
60522024-11-09T02:49:33.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60532024-11-09T02:49:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60542024-11-09T02:49:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60552024-11-09T02:49:33.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60562024-11-09T02:49:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60572024-11-09T02:49:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
60582024-11-09T02:49:33.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60592024-11-09T02:49:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60602024-11-09T02:49:33.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 367729868 } })
60612024-11-09T02:49:33.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
60622024-11-09T02:49:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
60632024-11-09T02:49:33.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60642024-11-09T02:49:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60652024-11-09T02:49:33.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60662024-11-09T02:49:33.034ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
60672024-11-09T02:49:33.034ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
60682024-11-09T02:49:33.034ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 23.639738ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
60692024-11-09T02:49:33.034ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 24.18566ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
60702024-11-09T02:49:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60712024-11-09T02:49:33.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60722024-11-09T02:49:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60732024-11-09T02:49:33.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60742024-11-09T02:49:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60752024-11-09T02:49:33.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60762024-11-09T02:49:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60772024-11-09T02:49:33.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60782024-11-09T02:49:33.041ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60792024-11-09T02:49:33.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60802024-11-09T02:49:33.042ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
60812024-11-09T02:49:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
60822024-11-09T02:49:33.043ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1076, tv_nsec: 383481973 } })
60832024-11-09T02:49:33.044ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
60842024-11-09T02:49:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
60852024-11-09T02:49:33.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
60862024-11-09T02:49:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
60872024-11-09T02:49:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60882024-11-09T02:49:33.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60892024-11-09T02:49:33.046ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60902024-11-09T02:49:33.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
60912024-11-09T02:49:33.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
60922024-11-09T02:49:33.048ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
60932024-11-09T02:49:33.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
60942024-11-09T02:49:33.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
60952024-11-09T02:49:33.049ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60962024-11-09T02:49:33.050ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60972024-11-09T02:49:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
60982024-11-09T02:49:33.053ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
60992024-11-09T02:49:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
61002024-11-09T02:49:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
61012024-11-09T02:49:33.055ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61022024-11-09T02:49:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61032024-11-09T02:49:33.056ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61042024-11-09T02:49:33.056ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
61052024-11-09T02:49:33.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61062024-11-09T02:49:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61072024-11-09T02:49:33.058ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61082024-11-09T02:49:33.058ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
61092024-11-09T02:49:33.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61102024-11-09T02:49:33.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
61112024-11-09T02:49:33.059ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61122024-11-09T02:49:33.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61132024-11-09T02:49:33.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61142024-11-09T02:49:33.061ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 51.427053ms iteration = 9 status = {"physical_disks_added":0}
61152024-11-09T02:49:33.061ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 51.77105ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61162024-11-09T02:49:33.062ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61172024-11-09T02:49:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
61182024-11-09T02:49:33.062ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
61192024-11-09T02:49:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
61202024-11-09T02:49:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61212024-11-09T02:49:33.066ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61222024-11-09T02:49:33.066ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61232024-11-09T02:49:33.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61242024-11-09T02:49:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61252024-11-09T02:49:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61262024-11-09T02:49:33.069ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61272024-11-09T02:49:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61282024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61292024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61302024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61312024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61322024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61332024-11-09T02:49:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61342024-11-09T02:49:33.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61352024-11-09T02:49:33.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61362024-11-09T02:49:33.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372024-11-09T02:49:33.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
61382024-11-09T02:49:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
61392024-11-09T02:49:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
61402024-11-09T02:49:33.074ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61412024-11-09T02:49:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
61422024-11-09T02:49:33.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
61432024-11-09T02:49:33.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
61442024-11-09T02:49:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
61452024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
61462024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
61472024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
61482024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
61492024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
61502024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61512024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
61522024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
61532024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61542024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61552024-11-09T02:49:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
61562024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61572024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
61582024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
61592024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
61602024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61612024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61622024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61632024-11-09T02:49:33.082ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 72.652371ms iteration = 7 status = 0
61642024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 76.046682ms iteration = 3 status = {"nsuccess":5}
61652024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
61662024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61672024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61682024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
61692024-11-09T02:49:33.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
61702024-11-09T02:49:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
61712024-11-09T02:49:33.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
61722024-11-09T02:49:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
61732024-11-09T02:49:33.101ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
61742024-11-09T02:49:33.101ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
61752024-11-09T02:49:33.101ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 91.799707ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
61762024-11-09T02:49:33.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
61772024-11-09T02:49:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
61782024-11-09T02:49:33.106ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
61792024-11-09T02:49:33.106ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
61802024-11-09T02:49:33.106ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 96.713108ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
61812024-11-09T02:49:33.116ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
61822024-11-09T02:49:33.116ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 106.696765ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
61832024-11-09T02:49:33.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61842024-11-09T02:49:33.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
61852024-11-09T02:49:33.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 107.354158ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
61862024-11-09T02:49:33.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61872024-11-09T02:49:33.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
61882024-11-09T02:49:33.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
61892024-11-09T02:49:33.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
61902024-11-09T02:49:33.139ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
61912024-11-09T02:49:33.142ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
61922024-11-09T02:49:33.143ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
61932024-11-09T02:49:33.143ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61942024-11-09T02:49:33.144ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0f5557e-4930-48b6-ada5-e87be7f4f72a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
61952024-11-09T02:49:33.144ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
61962024-11-09T02:49:33.146ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
61972024-11-09T02:49:33.154ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
61982024-11-09T02:49:33.154ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
61992024-11-09T02:49:33.154ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06e9b52a-119a-45f6-980e-fdde0f908fc1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62002024-11-09T02:49:33.154ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62012024-11-09T02:49:33.156ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62022024-11-09T02:49:33.205ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
62032024-11-09T02:49:33.205ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62042024-11-09T02:49:33.206ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "eb871e61-4ae5-4db6-a665-33d936013aa6", "content-length": "26", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62052024-11-09T02:49:33.206ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62062024-11-09T02:49:33.208ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
62072024-11-09T02:49:33.271ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
62082024-11-09T02:49:33.271ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62092024-11-09T02:49:33.272ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a317e18f-aa5d-413f-ad44-78de5640856a", "content-length": "372", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62102024-11-09T02:49:33.272ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62112024-11-09T02:49:33.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62122024-11-09T02:49:33.275ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62132024-11-09T02:49:33.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62142024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62152024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62162024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62172024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
62182024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
62192024-11-09T02:49:33.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
62202024-11-09T02:49:33.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62212024-11-09T02:49:33.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
62222024-11-09T02:49:33.289ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
62232024-11-09T02:49:33.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62242024-11-09T02:49:33.292ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
62252024-11-09T02:49:33.292ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 282.244963ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
62262024-11-09T02:49:33.297ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 287.443571ms iteration = 7 status = {}
62272024-11-09T02:49:33.298ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
62282024-11-09T02:49:33.314ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
62292024-11-09T02:49:33.314ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
62302024-11-09T02:49:33.314ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
62312024-11-09T02:49:33.314ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62322024-11-09T02:49:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62332024-11-09T02:49:33.315ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0984d30-b4b5-48c6-b32f-8563ba7d477b", "content-length": "1", "date": "Sat, 09 Nov 2024 02:49:32 GMT"} })
62342024-11-09T02:49:33.316ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
62352024-11-09T02:49:33.316ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
62362024-11-09T02:49:33.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62372024-11-09T02:49:33.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62382024-11-09T02:49:33.316ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62392024-11-09T02:49:33.318ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
62402024-11-09T02:49:33.318ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
62412024-11-09T02:49:33.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62422024-11-09T02:49:33.318ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7b722c97-8f53-40ae-abf2-618c5cf443fc", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62432024-11-09T02:49:33.318ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62442024-11-09T02:49:33.320ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "8f852080-919d-46e3-98a3-b30407af1ed0", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62452024-11-09T02:49:33.320ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62462024-11-09T02:49:33.320ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
62472024-11-09T02:49:33.320ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 310.570368ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
62482024-11-09T02:49:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
62492024-11-09T02:49:33.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
62502024-11-09T02:49:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
62512024-11-09T02:49:33.322ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
62522024-11-09T02:49:33.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 312.438677ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
62532024-11-09T02:49:33.323ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 313.345416ms iteration = 7 status = null
62542024-11-09T02:49:33.323ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
62552024-11-09T02:49:33.323ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
62562024-11-09T02:49:33.323ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
62572024-11-09T02:49:33.323ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 313.993839ms iteration = 5 status = {"generation":2}
62582024-11-09T02:49:33.350ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
62592024-11-09T02:49:33.350ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
62602024-11-09T02:49:33.350ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "0aff7128-9b37-43af-bff1-e26f6b707b7d", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62612024-11-09T02:49:33.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62622024-11-09T02:49:33.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62632024-11-09T02:49:33.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62642024-11-09T02:49:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62652024-11-09T02:49:33.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62662024-11-09T02:49:33.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62672024-11-09T02:49:33.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62682024-11-09T02:49:33.364ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
62692024-11-09T02:49:33.364ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
62702024-11-09T02:49:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
62712024-11-09T02:49:33.364ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
62722024-11-09T02:49:33.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
62732024-11-09T02:49:33.364ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "c86ed302-3ce5-4655-9d20-c8a569e78765", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62742024-11-09T02:49:33.366ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 356.828905ms iteration = 8 status = {}
62752024-11-09T02:49:33.367ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
62762024-11-09T02:49:33.367ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
62772024-11-09T02:49:33.367ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
62782024-11-09T02:49:33.367ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 357.634721ms iteration = 5 status = {"generation":1}
62792024-11-09T02:49:33.369ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
62802024-11-09T02:49:33.370ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a197aef5-2ef5-437a-a4ec-5e8a641f3254", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62812024-11-09T02:49:33.370ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62822024-11-09T02:49:33.371ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5a2fdc86-93c9-4308-933a-f9d6ed66e6db", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62832024-11-09T02:49:33.371ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62842024-11-09T02:49:33.376ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "360cf837-f094-453f-9e4e-b50c9dd9a36c", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62852024-11-09T02:49:33.376ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62862024-11-09T02:49:33.378ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
62872024-11-09T02:49:33.378ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 369.239131ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
62882024-11-09T02:49:33.386ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
62892024-11-09T02:49:33.386ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 376.261736ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
62902024-11-09T02:49:33.445ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
62912024-11-09T02:49:33.446ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "32b31afd-84e0-42a3-a8e1-a4da6da3a8ac", "content-length": "691", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
62922024-11-09T02:49:33.446ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
62932024-11-09T02:49:33.446ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
62942024-11-09T02:49:33.446ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
62952024-11-09T02:49:33.447ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 437.932009ms iteration = 7 status = {}
62962024-11-09T02:49:33.451ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62972024-11-09T02:49:33.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62982024-11-09T02:49:33.454ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
62992024-11-09T02:49:33.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63002024-11-09T02:49:33.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63012024-11-09T02:49:33.464ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63022024-11-09T02:49:33.464ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "53d90238-5613-4446-8fb5-e2e1f6f8ecff", "content-length": "134", "date": "Sat, 09 Nov 2024 02:49:32 GMT"} })
63032024-11-09T02:49:33.464ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63042024-11-09T02:49:33.464ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
63052024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63062024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63072024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63082024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63092024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63102024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63112024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63122024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63132024-11-09T02:49:33.465ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
63142024-11-09T02:49:33.465ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63152024-11-09T02:49:33.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63162024-11-09T02:49:33.467ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63172024-11-09T02:49:33.467ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6ef9d8fd-6d2e-4e60-9f95-a8d9769b5232", "content-length": "2", "date": "Sat, 09 Nov 2024 02:49:32 GMT"} })
63182024-11-09T02:49:33.467ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63192024-11-09T02:49:33.467ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "57233cb9-6fb8-42f1-a797-2a5d3bf8000f", "content-length": "52", "date": "Sat, 09 Nov 2024 02:49:32 GMT"} })
63202024-11-09T02:49:33.467ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
63212024-11-09T02:49:33.468ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
63222024-11-09T02:49:33.568ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "426f9fb1-5cc6-4856-a06b-959c91876497", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
63232024-11-09T02:49:33.568ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
63242024-11-09T02:49:33.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
63252024-11-09T02:49:33.568ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2119f79f-ed4a-4f6f-b01f-a5daa0f2aeca", "content-length": "682", "date": "Sat, 09 Nov 2024 02:49:33 GMT"} })
63262024-11-09T02:49:33.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63272024-11-09T02:49:33.569ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63282024-11-09T02:49:33.573ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63292024-11-09T02:49:33.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63302024-11-09T02:49:33.576ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63312024-11-09T02:49:33.577ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63322024-11-09T02:49:33.579ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63332024-11-09T02:49:33.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63342024-11-09T02:49:33.587ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 577.127816ms iteration = 7 status = {}
63352024-11-09T02:49:39.993ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
63362024-11-09T02:49:39.993ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
63372024-11-09T02:49:40.023ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
63382024-11-09T02:49:40.023ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55466
63392024-11-09T02:49:40.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55466 req_id = 8b3c33bb-469c-4c90-a454-3c6231904a3a roles = RoleSet { roles: {} } uri = /metrics/producers
63402024-11-09T02:49:40.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55466 req_id = 8b3c33bb-469c-4c90-a454-3c6231904a3a resource = Database result = Ok(()) uri = /metrics/producers
63412024-11-09T02:49:40.056ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
63422024-11-09T02:49:40.056ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33459 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55466 req_id = 8b3c33bb-469c-4c90-a454-3c6231904a3a response_code = 201 uri = /metrics/producers
63432024-11-09T02:49:40.056ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "8b3c33bb-469c-4c90-a454-3c6231904a3a", "content-length": "41", "date": "Sat, 09 Nov 2024 02:49:40 GMT"} })
63442024-11-09T02:49:40.057ZDEBGnexus (producer-registration-task): registered with nexus successfully
63452024-11-09T02:49:40.057ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
63462024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
63472024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63482024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
63492024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63502024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63512024-11-09T02:49:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63522024-11-09T02:49:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63532024-11-09T02:49:43.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63542024-11-09T02:49:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63552024-11-09T02:49:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63562024-11-09T02:49:43.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63572024-11-09T02:49:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63582024-11-09T02:49:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63592024-11-09T02:49:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63602024-11-09T02:49:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63612024-11-09T02:49:43.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
63622024-11-09T02:49:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63632024-11-09T02:49:43.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63642024-11-09T02:49:43.033ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
63652024-11-09T02:49:43.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.549507ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
63662024-11-09T02:49:43.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.36017ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63672024-11-09T02:49:45.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1051 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 1fdfbeef-74ae-439b-b0df-c555f401b357 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
63682024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
63692024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63702024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
63712024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63722024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63732024-11-09T02:49:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63742024-11-09T02:49:53.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63752024-11-09T02:49:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
63762024-11-09T02:49:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63772024-11-09T02:49:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63782024-11-09T02:49:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63792024-11-09T02:49:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63802024-11-09T02:49:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63812024-11-09T02:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
63822024-11-09T02:49:53.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63832024-11-09T02:49:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
63842024-11-09T02:49:53.033ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
63852024-11-09T02:49:53.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.837382ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
63862024-11-09T02:49:53.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63872024-11-09T02:49:53.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
63882024-11-09T02:49:53.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.394601ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63892024-11-09T02:50:00.148ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1230 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = d22d9d0f-c4c3-4901-94fc-a02837463c13 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
63902024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
63912024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
63922024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
63932024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
63942024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
63952024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
63962024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
63972024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
63982024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
63992024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
64002024-11-09T02:50:03.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64012024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64022024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64032024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
64042024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64052024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
64062024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
64072024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64082024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
64092024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
64102024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
64112024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
64122024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64132024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
64142024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
64152024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
64162024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64172024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64182024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64192024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64202024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64212024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
64222024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
64232024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64242024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
64252024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
64262024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
64272024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.26\u{b5}s iteration = 8 status = {"errors":[],"records_set_to_done":[]}
64282024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
64292024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.901\u{b5}s iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
64302024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.25\u{b5}s iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
64312024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.251\u{b5}s iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
64322024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64332024-11-09T02:50:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64342024-11-09T02:50:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
64352024-11-09T02:50:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64362024-11-09T02:50:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
64372024-11-09T02:50:03.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64382024-11-09T02:50:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.836829ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
64392024-11-09T02:50:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64402024-11-09T02:50:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64412024-11-09T02:50:03.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 354573756 } })
64422024-11-09T02:50:03.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 354704609 } })
64432024-11-09T02:50:03.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
64442024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
64452024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
64462024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64472024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64482024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
64492024-11-09T02:50:03.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
64502024-11-09T02:50:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64512024-11-09T02:50:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64522024-11-09T02:50:03.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64532024-11-09T02:50:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64542024-11-09T02:50:03.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64552024-11-09T02:50:03.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64562024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
64572024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64582024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64592024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
64602024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64612024-11-09T02:50:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64622024-11-09T02:50:03.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64632024-11-09T02:50:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64642024-11-09T02:50:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64652024-11-09T02:50:03.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64662024-11-09T02:50:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64672024-11-09T02:50:03.025ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
64682024-11-09T02:50:03.025ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 14.873008ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
64692024-11-09T02:50:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64702024-11-09T02:50:03.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64712024-11-09T02:50:03.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64722024-11-09T02:50:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
64732024-11-09T02:50:03.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
64742024-11-09T02:50:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
64752024-11-09T02:50:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
64762024-11-09T02:50:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64772024-11-09T02:50:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64782024-11-09T02:50:03.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1106, tv_nsec: 371141309 } })
64792024-11-09T02:50:03.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
64802024-11-09T02:50:03.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64812024-11-09T02:50:03.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64822024-11-09T02:50:03.045ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
64832024-11-09T02:50:03.045ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.691537ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
64842024-11-09T02:50:03.045ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64852024-11-09T02:50:03.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64862024-11-09T02:50:03.049ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64872024-11-09T02:50:03.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64882024-11-09T02:50:03.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64892024-11-09T02:50:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
64902024-11-09T02:50:03.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
64912024-11-09T02:50:03.056ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64922024-11-09T02:50:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
64932024-11-09T02:50:03.058ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
64942024-11-09T02:50:03.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64952024-11-09T02:50:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
64962024-11-09T02:50:03.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
64972024-11-09T02:50:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
64982024-11-09T02:50:03.060ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
64992024-11-09T02:50:03.060ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
65002024-11-09T02:50:03.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65012024-11-09T02:50:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65022024-11-09T02:50:03.061ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 50.547264ms iteration = 8 status = 0
65032024-11-09T02:50:03.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65042024-11-09T02:50:03.062ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 51.587556ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
65052024-11-09T02:50:03.064ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65062024-11-09T02:50:03.064ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65072024-11-09T02:50:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65082024-11-09T02:50:03.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 68.731371ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
65092024-11-09T02:50:03.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
65102024-11-09T02:50:03.079ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
65112024-11-09T02:50:03.079ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65122024-11-09T02:50:03.079ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65132024-11-09T02:50:03.080ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f2dc5fd-08e1-457b-a110-104dbe849334", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:02 GMT"} })
65142024-11-09T02:50:03.080ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65152024-11-09T02:50:03.080ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d00c132-53cd-48f7-a650-fae49eee58f0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65162024-11-09T02:50:03.080ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65172024-11-09T02:50:03.082ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65182024-11-09T02:50:03.083ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
65192024-11-09T02:50:03.090ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65202024-11-09T02:50:03.090ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
65212024-11-09T02:50:03.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65222024-11-09T02:50:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65232024-11-09T02:50:03.121ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65242024-11-09T02:50:03.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65252024-11-09T02:50:03.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
65262024-11-09T02:50:03.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
65272024-11-09T02:50:03.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 111.76931ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
65282024-11-09T02:50:03.133ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
65292024-11-09T02:50:03.133ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
65302024-11-09T02:50:03.134ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd90b526-4849-4eca-a072-f520bd39e9b3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65312024-11-09T02:50:03.134ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
65322024-11-09T02:50:03.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
65332024-11-09T02:50:03.142ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.726932ms iteration = 10 status = {"physical_disks_added":0}
65342024-11-09T02:50:03.186ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
65352024-11-09T02:50:03.186ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6b4efab0-04bd-401e-83f6-f21f69240a09", "content-length": "1", "date": "Sat, 09 Nov 2024 02:50:02 GMT"} })
65362024-11-09T02:50:03.188ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
65372024-11-09T02:50:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65382024-11-09T02:50:03.191ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 180.608133ms iteration = 8 status = null
65392024-11-09T02:50:03.192ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.467061ms iteration = 8 status = {}
65402024-11-09T02:50:03.212ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
65412024-11-09T02:50:03.212ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65422024-11-09T02:50:03.212ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "17c92910-72e1-4cf7-84e6-f89fbc3b7c31", "content-length": "372", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65432024-11-09T02:50:03.212ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65442024-11-09T02:50:03.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65452024-11-09T02:50:03.219ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65462024-11-09T02:50:03.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65472024-11-09T02:50:03.228ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65482024-11-09T02:50:03.230ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65492024-11-09T02:50:03.230ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65502024-11-09T02:50:03.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65512024-11-09T02:50:03.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65522024-11-09T02:50:03.236ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
65532024-11-09T02:50:03.236ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65542024-11-09T02:50:03.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65552024-11-09T02:50:03.240ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
65562024-11-09T02:50:03.241ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
65572024-11-09T02:50:03.241ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "10b24079-1015-4e75-a575-8db38ee70f50", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65582024-11-09T02:50:03.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65592024-11-09T02:50:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65602024-11-09T02:50:03.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65612024-11-09T02:50:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65622024-11-09T02:50:03.247ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65632024-11-09T02:50:03.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65642024-11-09T02:50:03.250ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
65652024-11-09T02:50:03.250ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
65662024-11-09T02:50:03.251ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ba02440c-c355-4b7b-9569-98494fea1ee5", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65672024-11-09T02:50:03.253ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 243.146185ms iteration = 9 status = {}
65682024-11-09T02:50:03.277ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
65692024-11-09T02:50:03.277ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c4f1989f-6f45-4834-a10c-9a901262b1b9", "content-length": "691", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
65702024-11-09T02:50:03.277ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
65712024-11-09T02:50:03.277ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
65722024-11-09T02:50:03.277ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
65732024-11-09T02:50:03.279ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 268.821876ms iteration = 8 status = {}
65742024-11-09T02:50:03.296ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65752024-11-09T02:50:03.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65762024-11-09T02:50:03.299ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
65772024-11-09T02:50:03.299ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65782024-11-09T02:50:03.299ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65792024-11-09T02:50:03.308ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
65802024-11-09T02:50:03.309ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9f56092-e885-4534-9da1-25abd041cc19", "content-length": "134", "date": "Sat, 09 Nov 2024 02:50:02 GMT"} })
65812024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
65822024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
65832024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
65842024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
65852024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65862024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65872024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65882024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65892024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
65902024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
65912024-11-09T02:50:03.309ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
65922024-11-09T02:50:03.309ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65932024-11-09T02:50:03.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65942024-11-09T02:50:03.312ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
65952024-11-09T02:50:03.312ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c106ddfc-3a80-4674-aa1e-7cee3197a45d", "content-length": "2", "date": "Sat, 09 Nov 2024 02:50:02 GMT"} })
65962024-11-09T02:50:03.312ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
65972024-11-09T02:50:03.312ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b18bf9f1-e1c8-497a-a7e0-9415ed601635", "content-length": "52", "date": "Sat, 09 Nov 2024 02:50:02 GMT"} })
65982024-11-09T02:50:03.312ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
65992024-11-09T02:50:03.312ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
66002024-11-09T02:50:03.424ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "982a2f82-292f-4c8d-8048-ac47ab8303e2", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
66012024-11-09T02:50:03.424ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
66022024-11-09T02:50:03.424ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
66032024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "668d56ea-aca5-4613-9854-b13bac488e18", "content-length": "682", "date": "Sat, 09 Nov 2024 02:50:03 GMT"} })
66042024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66052024-11-09T02:50:03.425ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66062024-11-09T02:50:03.429ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66072024-11-09T02:50:03.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66082024-11-09T02:50:03.433ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66092024-11-09T02:50:03.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66102024-11-09T02:50:03.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66112024-11-09T02:50:03.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
66122024-11-09T02:50:03.443ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 432.822464ms iteration = 8 status = {}
66132024-11-09T02:50:13.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
66142024-11-09T02:50:13.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
66152024-11-09T02:50:13.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66162024-11-09T02:50:13.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66172024-11-09T02:50:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66182024-11-09T02:50:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66192024-11-09T02:50:13.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66202024-11-09T02:50:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66212024-11-09T02:50:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66222024-11-09T02:50:13.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.127885ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66232024-11-09T02:50:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66242024-11-09T02:50:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66252024-11-09T02:50:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66262024-11-09T02:50:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66272024-11-09T02:50:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66282024-11-09T02:50:13.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66292024-11-09T02:50:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
66302024-11-09T02:50:13.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66312024-11-09T02:50:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66322024-11-09T02:50:13.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
66332024-11-09T02:50:13.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.747381ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
66342024-11-09T02:50:15.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1324 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 70d08a87-9a5a-4ff8-b1c0-fef436eef8cd response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
66352024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
66362024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
66372024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66382024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66392024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66402024-11-09T02:50:23.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66412024-11-09T02:50:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66422024-11-09T02:50:23.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66432024-11-09T02:50:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66442024-11-09T02:50:23.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.055385ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66452024-11-09T02:50:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
66462024-11-09T02:50:23.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66472024-11-09T02:50:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66482024-11-09T02:50:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66492024-11-09T02:50:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66502024-11-09T02:50:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66512024-11-09T02:50:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
66522024-11-09T02:50:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66532024-11-09T02:50:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66542024-11-09T02:50:23.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
66552024-11-09T02:50:23.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.156807ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
66562024-11-09T02:50:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1517 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 505f4437-b051-49f3-a063-d841d4f8f341 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
66572024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
66582024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
66592024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
66602024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66612024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
66622024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66632024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
66642024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
66652024-11-09T02:50:33.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
66662024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
66672024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
66682024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
66692024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66702024-11-09T02:50:33.010ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:40:33.010424064 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
66712024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
66722024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
66732024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
66742024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
66752024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
66762024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
66772024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66782024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
66792024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
66802024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66812024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
66822024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66832024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
66842024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
66852024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
66862024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
66872024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66882024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
66892024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
66902024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66912024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
66922024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
66932024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
66942024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
66952024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66962024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
66972024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
66982024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66992024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
67002024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67012024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
67022024-11-09T02:50:33.010ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
67032024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
67042024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.68\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
67052024-11-09T02:50:33.010ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
67062024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67072024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
67082024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.48\u{b5}s iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67092024-11-09T02:50:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
67102024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
67112024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.49\u{b5}s iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
67122024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
67132024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
67142024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.041\u{b5}s iteration = 9 status = {"errors":[],"records_set_to_done":[]}
67152024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
67162024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.19\u{b5}s iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67172024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
67182024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
67192024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67202024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
67212024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
67222024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
67232024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
67242024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
67252024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67262024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67272024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67282024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67292024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
67302024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67312024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
67322024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67332024-11-09T02:50:33.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 350597864 } })
67342024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67352024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67362024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
67372024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67382024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
67392024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
67402024-11-09T02:50:33.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 350824329 } })
67412024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67422024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
67432024-11-09T02:50:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.314747ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
67442024-11-09T02:50:33.012ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
67452024-11-09T02:50:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.503281ms iteration = 6 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
67462024-11-09T02:50:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67472024-11-09T02:50:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.929951ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
67482024-11-09T02:50:33.014ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:40:33.010424064 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
67492024-11-09T02:50:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.893911ms iteration = 5 status = {"expiration":"2024-11-09T02:40:33.010424064Z","pruned":[]}
67502024-11-09T02:50:33.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 354876262 } })
67512024-11-09T02:50:33.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67522024-11-09T02:50:33.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
67532024-11-09T02:50:33.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67542024-11-09T02:50:33.016ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67552024-11-09T02:50:33.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 356512726 } })
67562024-11-09T02:50:33.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
67572024-11-09T02:50:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
67582024-11-09T02:50:33.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
67592024-11-09T02:50:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
67602024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67612024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67622024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67632024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
67642024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67652024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67662024-11-09T02:50:33.019ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67672024-11-09T02:50:33.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67682024-11-09T02:50:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67692024-11-09T02:50:33.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67702024-11-09T02:50:33.022ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.487848ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
67712024-11-09T02:50:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
67722024-11-09T02:50:33.023ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
67732024-11-09T02:50:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
67742024-11-09T02:50:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
67752024-11-09T02:50:33.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
67762024-11-09T02:50:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
67772024-11-09T02:50:33.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67782024-11-09T02:50:33.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67792024-11-09T02:50:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
67802024-11-09T02:50:33.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
67812024-11-09T02:50:33.027ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
67822024-11-09T02:50:33.027ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
67832024-11-09T02:50:33.027ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 16.497201ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
67842024-11-09T02:50:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
67852024-11-09T02:50:33.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67862024-11-09T02:50:33.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1136, tv_nsec: 368412112 } })
67872024-11-09T02:50:33.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
67882024-11-09T02:50:33.029ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
67892024-11-09T02:50:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
67902024-11-09T02:50:33.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
67912024-11-09T02:50:33.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67922024-11-09T02:50:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67932024-11-09T02:50:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67942024-11-09T02:50:33.033ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
67952024-11-09T02:50:33.033ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
67962024-11-09T02:50:33.033ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
67972024-11-09T02:50:33.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67982024-11-09T02:50:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67992024-11-09T02:50:33.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68002024-11-09T02:50:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68012024-11-09T02:50:33.042ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68022024-11-09T02:50:33.044ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68032024-11-09T02:50:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68042024-11-09T02:50:33.045ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68052024-11-09T02:50:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68062024-11-09T02:50:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
68072024-11-09T02:50:33.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68082024-11-09T02:50:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68092024-11-09T02:50:33.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
68102024-11-09T02:50:33.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
68112024-11-09T02:50:33.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68122024-11-09T02:50:33.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68132024-11-09T02:50:33.058ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68142024-11-09T02:50:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68152024-11-09T02:50:33.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68162024-11-09T02:50:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68172024-11-09T02:50:33.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68182024-11-09T02:50:33.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68192024-11-09T02:50:33.067ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68202024-11-09T02:50:33.067ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
68212024-11-09T02:50:33.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68222024-11-09T02:50:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68232024-11-09T02:50:33.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68242024-11-09T02:50:33.069ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68252024-11-09T02:50:33.071ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68262024-11-09T02:50:33.071ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
68272024-11-09T02:50:33.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
68282024-11-09T02:50:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
68292024-11-09T02:50:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
68302024-11-09T02:50:33.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
68312024-11-09T02:50:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
68322024-11-09T02:50:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
68332024-11-09T02:50:33.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68342024-11-09T02:50:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68352024-11-09T02:50:33.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68362024-11-09T02:50:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68372024-11-09T02:50:33.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68382024-11-09T02:50:33.083ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68392024-11-09T02:50:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68402024-11-09T02:50:33.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68412024-11-09T02:50:33.086ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68422024-11-09T02:50:33.088ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
68432024-11-09T02:50:33.088ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
68442024-11-09T02:50:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
68452024-11-09T02:50:33.089ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
68462024-11-09T02:50:33.089ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
68472024-11-09T02:50:33.089ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68482024-11-09T02:50:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68492024-11-09T02:50:33.091ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
68502024-11-09T02:50:33.091ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
68512024-11-09T02:50:33.091ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68522024-11-09T02:50:33.091ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.491474ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
68532024-11-09T02:50:33.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68542024-11-09T02:50:33.093ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
68552024-11-09T02:50:33.093ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68562024-11-09T02:50:33.093ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68572024-11-09T02:50:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
68582024-11-09T02:50:33.094ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
68592024-11-09T02:50:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
68602024-11-09T02:50:33.097ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
68612024-11-09T02:50:33.097ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 87.11838ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
68622024-11-09T02:50:33.098ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
68632024-11-09T02:50:33.098ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
68642024-11-09T02:50:33.098ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
68652024-11-09T02:50:33.098ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 87.846516ms iteration = 6 status = {"generation":1}
68662024-11-09T02:50:33.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68672024-11-09T02:50:33.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68682024-11-09T02:50:33.100ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 90.423179ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68692024-11-09T02:50:33.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68702024-11-09T02:50:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68712024-11-09T02:50:33.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 92.882119ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
68722024-11-09T02:50:33.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
68732024-11-09T02:50:33.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
68742024-11-09T02:50:33.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68752024-11-09T02:50:33.106ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
68762024-11-09T02:50:33.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 96.214908ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
68772024-11-09T02:50:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
68782024-11-09T02:50:33.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
68792024-11-09T02:50:33.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
68802024-11-09T02:50:33.111ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 100.497227ms iteration = 9 status = 0
68812024-11-09T02:50:33.112ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
68822024-11-09T02:50:33.112ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
68832024-11-09T02:50:33.112ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 101.790744ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
68842024-11-09T02:50:33.119ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
68852024-11-09T02:50:33.119ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
68862024-11-09T02:50:33.119ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
68872024-11-09T02:50:33.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68882024-11-09T02:50:33.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68892024-11-09T02:50:33.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68902024-11-09T02:50:33.123ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68912024-11-09T02:50:33.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68922024-11-09T02:50:33.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68932024-11-09T02:50:33.126ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
68942024-11-09T02:50:33.126ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
68952024-11-09T02:50:33.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
68962024-11-09T02:50:33.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
68972024-11-09T02:50:33.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68982024-11-09T02:50:33.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
68992024-11-09T02:50:33.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
69002024-11-09T02:50:33.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
69012024-11-09T02:50:33.134ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
69022024-11-09T02:50:33.134ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
69032024-11-09T02:50:33.134ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
69042024-11-09T02:50:33.134ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 123.754198ms iteration = 6 status = {"generation":2}
69052024-11-09T02:50:33.145ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69062024-11-09T02:50:33.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69072024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
69082024-11-09T02:50:33.168ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 157.934724ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
69092024-11-09T02:50:33.169ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
69102024-11-09T02:50:33.184ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
69112024-11-09T02:50:33.184ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69122024-11-09T02:50:33.184ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8878e187-c547-4a87-83da-5734e4da1c36", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:32 GMT"} })
69132024-11-09T02:50:33.184ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69142024-11-09T02:50:33.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
69152024-11-09T02:50:33.185ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69162024-11-09T02:50:33.186ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e9bbc027-5e1d-4699-ba0e-b1bf1379ecd2", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:32 GMT"} })
69172024-11-09T02:50:33.186ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69182024-11-09T02:50:33.187ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69192024-11-09T02:50:33.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
69202024-11-09T02:50:33.223ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 212.734536ms iteration = 11 status = {"physical_disks_added":0}
69212024-11-09T02:50:33.273ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
69222024-11-09T02:50:33.273ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 263.432655ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
69232024-11-09T02:50:33.375ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
69242024-11-09T02:50:33.379ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 368.597107ms iteration = 9 status = {}
69252024-11-09T02:50:33.396ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
69262024-11-09T02:50:33.396ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
69272024-11-09T02:50:33.397ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a03ae9d3-aca9-4ba7-9b78-49e2eb7ef45c", "content-length": "26", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69282024-11-09T02:50:33.397ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
69292024-11-09T02:50:33.399ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
69302024-11-09T02:50:33.401ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
69312024-11-09T02:50:33.479ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
69322024-11-09T02:50:33.479ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69332024-11-09T02:50:33.480ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "72ea5931-c482-4715-9f16-86d687327fda", "content-length": "372", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69342024-11-09T02:50:33.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69352024-11-09T02:50:33.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69362024-11-09T02:50:33.498ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
69372024-11-09T02:50:33.498ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
69382024-11-09T02:50:33.499ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e37def96-42e8-49e7-96dd-7b94720f4d47", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69392024-11-09T02:50:33.499ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69402024-11-09T02:50:33.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69412024-11-09T02:50:33.501ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69422024-11-09T02:50:33.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69432024-11-09T02:50:33.505ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69442024-11-09T02:50:33.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69452024-11-09T02:50:33.508ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
69462024-11-09T02:50:33.508ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
69472024-11-09T02:50:33.508ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "618b53af-310c-4c66-bba5-94385d27bbda", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69482024-11-09T02:50:33.509ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 499.451801ms iteration = 10 status = {}
69492024-11-09T02:50:33.524ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
69502024-11-09T02:50:33.524ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3398113c-37d4-4664-9daa-d2a89f0c21d4", "content-length": "1", "date": "Sat, 09 Nov 2024 02:50:32 GMT"} })
69512024-11-09T02:50:33.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69522024-11-09T02:50:33.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69532024-11-09T02:50:33.529ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 519.026276ms iteration = 9 status = null
69542024-11-09T02:50:33.533ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
69552024-11-09T02:50:33.534ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bd1ee770-b0fd-4419-9cf3-8f38f3e13e59", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69562024-11-09T02:50:33.534ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69572024-11-09T02:50:33.535ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "9f05f61f-1a52-4bb3-b263-4083518e388d", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69582024-11-09T02:50:33.535ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69592024-11-09T02:50:33.537ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "78dd1594-8620-461a-96ef-48f360936c77", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69602024-11-09T02:50:33.537ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69612024-11-09T02:50:33.539ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
69622024-11-09T02:50:33.539ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 529.45249ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
69632024-11-09T02:50:33.540ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
69642024-11-09T02:50:33.540ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "86b00163-952b-43e8-8396-51e0688b21d7", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69652024-11-09T02:50:33.540ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69662024-11-09T02:50:33.542ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "9b150b78-f69a-4d90-94f1-90c37c6a1bc7", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69672024-11-09T02:50:33.542ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69682024-11-09T02:50:33.544ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
69692024-11-09T02:50:33.544ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 533.447284ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
69702024-11-09T02:50:33.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69712024-11-09T02:50:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69722024-11-09T02:50:33.564ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
69732024-11-09T02:50:33.564ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69742024-11-09T02:50:33.564ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69752024-11-09T02:50:33.576ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
69762024-11-09T02:50:33.576ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69772024-11-09T02:50:33.576ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3cc6b863-ee56-44d2-8ce8-20586fd65439", "content-length": "134", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69782024-11-09T02:50:33.576ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
69792024-11-09T02:50:33.576ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
69802024-11-09T02:50:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69812024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
69822024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
69832024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69842024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69852024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69862024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69872024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
69882024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
69892024-11-09T02:50:33.577ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
69902024-11-09T02:50:33.577ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69912024-11-09T02:50:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69922024-11-09T02:50:33.578ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69932024-11-09T02:50:33.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
69942024-11-09T02:50:33.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbe2c34a-1e1a-4360-8d74-aa05ddee23c6", "content-length": "2", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69952024-11-09T02:50:33.580ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
69962024-11-09T02:50:33.580ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffdcf163-10f2-44e9-aeb4-1a414e371a72", "content-length": "52", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
69972024-11-09T02:50:33.580ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
69982024-11-09T02:50:33.580ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
69992024-11-09T02:50:33.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70002024-11-09T02:50:33.581ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70012024-11-09T02:50:33.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70022024-11-09T02:50:33.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70032024-11-09T02:50:33.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70042024-11-09T02:50:33.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70052024-11-09T02:50:33.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70062024-11-09T02:50:33.679ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "23853152-79b3-4b8e-87ff-fe01ac174492", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
70072024-11-09T02:50:33.679ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
70082024-11-09T02:50:33.679ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
70092024-11-09T02:50:33.679ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
70102024-11-09T02:50:33.680ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "f51d0ce7-b886-4d0f-acf5-516e86e377e7", "content-length": "682", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
70112024-11-09T02:50:33.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70122024-11-09T02:50:33.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70132024-11-09T02:50:33.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70142024-11-09T02:50:33.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70152024-11-09T02:50:33.686ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "1817a66d-4e71-47d9-a2f8-39962a47f3a4", "content-length": "691", "date": "Sat, 09 Nov 2024 02:50:33 GMT"} })
70162024-11-09T02:50:33.686ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
70172024-11-09T02:50:33.686ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
70182024-11-09T02:50:33.686ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
70192024-11-09T02:50:33.687ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 676.725784ms iteration = 9 status = {}
70202024-11-09T02:50:33.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70212024-11-09T02:50:33.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70222024-11-09T02:50:33.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70232024-11-09T02:50:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
70242024-11-09T02:50:33.698ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 688.004058ms iteration = 9 status = {}
70252024-11-09T02:50:35.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5423dab1-8933-40d4-bdaa-d5d95eb471fc roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70262024-11-09T02:50:35.142ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5423dab1-8933-40d4-bdaa-d5d95eb471fc resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70272024-11-09T02:50:35.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2729 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = 5423dab1-8933-40d4-bdaa-d5d95eb471fc response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
70282024-11-09T02:50:35.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d226ae93-980f-494a-8587-f370fc35e3d1 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70292024-11-09T02:50:35.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d226ae93-980f-494a-8587-f370fc35e3d1 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70302024-11-09T02:50:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:50353 req_id = d226ae93-980f-494a-8587-f370fc35e3d1 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
70312024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
70322024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70332024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
70342024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70352024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70362024-11-09T02:50:43.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70372024-11-09T02:50:43.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70382024-11-09T02:50:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70392024-11-09T02:50:43.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70402024-11-09T02:50:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70412024-11-09T02:50:43.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70422024-11-09T02:50:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70432024-11-09T02:50:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70442024-11-09T02:50:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70452024-11-09T02:50:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70462024-11-09T02:50:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
70472024-11-09T02:50:43.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70482024-11-09T02:50:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70492024-11-09T02:50:43.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
70502024-11-09T02:50:43.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.788639ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
70512024-11-09T02:50:43.041ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.646514ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70522024-11-09T02:50:45.149ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1099 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 532be65d-7c3a-49b7-9bb3-21328660c51c response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
70532024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
70542024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70552024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
70562024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70572024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70582024-11-09T02:50:53.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70592024-11-09T02:50:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70602024-11-09T02:50:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
70612024-11-09T02:50:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70622024-11-09T02:50:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70632024-11-09T02:50:53.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70642024-11-09T02:50:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70652024-11-09T02:50:53.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70662024-11-09T02:50:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
70672024-11-09T02:50:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70682024-11-09T02:50:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70692024-11-09T02:50:53.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
70702024-11-09T02:50:53.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.000885ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
70712024-11-09T02:50:53.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70722024-11-09T02:50:53.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70732024-11-09T02:50:53.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.731447ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70742024-11-09T02:51:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1664 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = fcaa184e-68f2-42b9-9d60-24767e8ddbcb response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
70752024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
70762024-11-09T02:51:03.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
70772024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
70782024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70792024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
70802024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
70812024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
70822024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70832024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
70842024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70852024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
70862024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
70872024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
70882024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
70892024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70902024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
70912024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70922024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
70932024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
70942024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70952024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
70962024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
70972024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70982024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
70992024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71002024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
71012024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71022024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71032024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71042024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71052024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71062024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71072024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
71082024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71092024-11-09T02:51:03.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
71102024-11-09T02:51:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71112024-11-09T02:51:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71122024-11-09T02:51:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71132024-11-09T02:51:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
71142024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
71152024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
71162024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
71172024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.111\u{b5}s iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
71182024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.261\u{b5}s iteration = 10 status = {"errors":[],"records_set_to_done":[]}
71192024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
71202024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.701\u{b5}s iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
71212024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 7.061\u{b5}s iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
71222024-11-09T02:51:03.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71232024-11-09T02:51:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.693416ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
71242024-11-09T02:51:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71252024-11-09T02:51:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71262024-11-09T02:51:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71272024-11-09T02:51:03.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71282024-11-09T02:51:03.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 354988055 } })
71292024-11-09T02:51:03.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
71302024-11-09T02:51:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
71312024-11-09T02:51:03.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71322024-11-09T02:51:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71332024-11-09T02:51:03.022ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71342024-11-09T02:51:03.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71352024-11-09T02:51:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71362024-11-09T02:51:03.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71372024-11-09T02:51:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71382024-11-09T02:51:03.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 364107933 } })
71392024-11-09T02:51:03.025ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 14.800316ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71402024-11-09T02:51:03.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71412024-11-09T02:51:03.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
71422024-11-09T02:51:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71432024-11-09T02:51:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71442024-11-09T02:51:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71452024-11-09T02:51:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71462024-11-09T02:51:03.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71472024-11-09T02:51:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71482024-11-09T02:51:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71492024-11-09T02:51:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
71502024-11-09T02:51:03.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
71512024-11-09T02:51:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
71522024-11-09T02:51:03.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
71532024-11-09T02:51:03.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
71542024-11-09T02:51:03.045ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71552024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71562024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71572024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71582024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71592024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71602024-11-09T02:51:03.047ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71612024-11-09T02:51:03.048ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71622024-11-09T02:51:03.048ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
71632024-11-09T02:51:03.048ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71642024-11-09T02:51:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71652024-11-09T02:51:03.049ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
71662024-11-09T02:51:03.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
71672024-11-09T02:51:03.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
71682024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71692024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71702024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71712024-11-09T02:51:03.052ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
71722024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
71732024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
71742024-11-09T02:51:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
71752024-11-09T02:51:03.053ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71762024-11-09T02:51:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
71772024-11-09T02:51:03.054ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71782024-11-09T02:51:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71792024-11-09T02:51:03.055ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
71802024-11-09T02:51:03.055ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 45.47041ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
71812024-11-09T02:51:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
71822024-11-09T02:51:03.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
71832024-11-09T02:51:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
71842024-11-09T02:51:03.056ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1166, tv_nsec: 395880810 } })
71852024-11-09T02:51:03.057ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
71862024-11-09T02:51:03.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71872024-11-09T02:51:03.058ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 48.014083ms iteration = 10 status = 0
71882024-11-09T02:51:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
71892024-11-09T02:51:03.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71902024-11-09T02:51:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71912024-11-09T02:51:03.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 65.637017ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
71922024-11-09T02:51:03.076ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
71932024-11-09T02:51:03.076ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.491604ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
71942024-11-09T02:51:03.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71952024-11-09T02:51:03.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
71962024-11-09T02:51:03.080ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
71972024-11-09T02:51:03.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
71982024-11-09T02:51:03.081ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
71992024-11-09T02:51:03.081ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72002024-11-09T02:51:03.082ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b4a80d09-d124-4dbf-b4be-279ca4aa4b8d", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72012024-11-09T02:51:03.082ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72022024-11-09T02:51:03.084ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72032024-11-09T02:51:03.091ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
72042024-11-09T02:51:03.091ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
72052024-11-09T02:51:03.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 81.654207ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
72062024-11-09T02:51:03.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
72072024-11-09T02:51:03.103ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72082024-11-09T02:51:03.103ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0682a4f-1841-4661-b89c-b5d56e51570b", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72092024-11-09T02:51:03.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72102024-11-09T02:51:03.104ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
72112024-11-09T02:51:03.113ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72122024-11-09T02:51:03.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72132024-11-09T02:51:03.138ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 128.025526ms iteration = 12 status = {"physical_disks_added":0}
72142024-11-09T02:51:03.190ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
72152024-11-09T02:51:03.190ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
72162024-11-09T02:51:03.190ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5f2da692-ede3-40b3-a533-264280fef8ad", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72172024-11-09T02:51:03.190ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
72182024-11-09T02:51:03.193ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
72192024-11-09T02:51:03.195ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
72202024-11-09T02:51:03.195ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c36f4100-29d7-47f0-adf4-b423299d60ac", "content-length": "1", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72212024-11-09T02:51:03.197ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72222024-11-09T02:51:03.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72232024-11-09T02:51:03.214ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 204.464256ms iteration = 10 status = null
72242024-11-09T02:51:03.245ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 234.890224ms iteration = 10 status = {}
72252024-11-09T02:51:03.249ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72262024-11-09T02:51:03.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72272024-11-09T02:51:03.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72282024-11-09T02:51:03.252ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72292024-11-09T02:51:03.252ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72302024-11-09T02:51:03.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72312024-11-09T02:51:03.267ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
72322024-11-09T02:51:03.267ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72332024-11-09T02:51:03.268ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b2039de-389c-4bba-965d-61ac7c2aaa0b", "content-length": "372", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72342024-11-09T02:51:03.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72352024-11-09T02:51:03.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72362024-11-09T02:51:03.288ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
72372024-11-09T02:51:03.288ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
72382024-11-09T02:51:03.288ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c9887714-946c-4410-9b43-aa226a2d1cae", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72392024-11-09T02:51:03.288ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72402024-11-09T02:51:03.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72412024-11-09T02:51:03.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72422024-11-09T02:51:03.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72432024-11-09T02:51:03.294ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72442024-11-09T02:51:03.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72452024-11-09T02:51:03.298ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
72462024-11-09T02:51:03.298ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
72472024-11-09T02:51:03.298ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "dfd42964-ec2b-49ba-ac67-67f14b8a919e", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72482024-11-09T02:51:03.300ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72492024-11-09T02:51:03.300ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 290.379781ms iteration = 11 status = {}
72502024-11-09T02:51:03.302ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
72512024-11-09T02:51:03.302ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72522024-11-09T02:51:03.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72532024-11-09T02:51:03.354ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
72542024-11-09T02:51:03.354ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df6d4779-03cc-4665-87b5-0483df183abb", "content-length": "691", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72552024-11-09T02:51:03.354ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
72562024-11-09T02:51:03.354ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
72572024-11-09T02:51:03.354ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
72582024-11-09T02:51:03.355ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72592024-11-09T02:51:03.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72602024-11-09T02:51:03.356ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 346.144674ms iteration = 10 status = {}
72612024-11-09T02:51:03.358ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
72622024-11-09T02:51:03.358ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72632024-11-09T02:51:03.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72642024-11-09T02:51:03.368ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
72652024-11-09T02:51:03.369ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "7cbdfa72-26b3-405f-8a2f-2ae51c17cc2a", "content-length": "134", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72662024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
72672024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
72682024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
72692024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
72702024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72712024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72722024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72732024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72742024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
72752024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
72762024-11-09T02:51:03.369ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
72772024-11-09T02:51:03.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72782024-11-09T02:51:03.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72792024-11-09T02:51:03.371ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
72802024-11-09T02:51:03.371ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5cbf3b1-faff-4180-9bed-be145a81c5fd", "content-length": "2", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72812024-11-09T02:51:03.371ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
72822024-11-09T02:51:03.372ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "96383cad-fc62-4805-a6fd-2dc643b2abf0", "content-length": "52", "date": "Sat, 09 Nov 2024 02:51:02 GMT"} })
72832024-11-09T02:51:03.372ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
72842024-11-09T02:51:03.372ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
72852024-11-09T02:51:03.482ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "874303a8-8dbd-48a4-b244-8a8320b0f0c4", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72862024-11-09T02:51:03.482ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
72872024-11-09T02:51:03.482ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
72882024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "8890d9e4-f383-45db-a7d5-2ea9b8fecdc3", "content-length": "682", "date": "Sat, 09 Nov 2024 02:51:03 GMT"} })
72892024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72902024-11-09T02:51:03.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72912024-11-09T02:51:03.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72922024-11-09T02:51:03.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72932024-11-09T02:51:03.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72942024-11-09T02:51:03.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72952024-11-09T02:51:03.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72962024-11-09T02:51:03.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72972024-11-09T02:51:03.503ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 493.528318ms iteration = 10 status = {}
72982024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
72992024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
73002024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73012024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73022024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73032024-11-09T02:51:13.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73042024-11-09T02:51:13.038ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73052024-11-09T02:51:13.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73062024-11-09T02:51:13.040ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.955149ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73072024-11-09T02:51:13.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73082024-11-09T02:51:13.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73092024-11-09T02:51:13.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73102024-11-09T02:51:13.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73112024-11-09T02:51:13.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73122024-11-09T02:51:13.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73132024-11-09T02:51:13.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142024-11-09T02:51:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
73152024-11-09T02:51:13.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73162024-11-09T02:51:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73172024-11-09T02:51:13.061ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
73182024-11-09T02:51:13.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.31009ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
73192024-11-09T02:51:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1099 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 0cd8e70b-7ff6-4ac3-813b-087bacd9b799 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
73202024-11-09T02:51:23.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
73212024-11-09T02:51:23.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73222024-11-09T02:51:23.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
73232024-11-09T02:51:23.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73242024-11-09T02:51:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73252024-11-09T02:51:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73262024-11-09T02:51:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73272024-11-09T02:51:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73282024-11-09T02:51:23.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292024-11-09T02:51:23.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.115525ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
73302024-11-09T02:51:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73312024-11-09T02:51:23.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73322024-11-09T02:51:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73332024-11-09T02:51:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73342024-11-09T02:51:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73352024-11-09T02:51:23.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73362024-11-09T02:51:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
73372024-11-09T02:51:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73382024-11-09T02:51:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73392024-11-09T02:51:23.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
73402024-11-09T02:51:23.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.25092ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
73412024-11-09T02:51:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1109 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 6c8ee758-fca2-4991-a6f4-64e3abcaa3ea response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
73422024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
73432024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
73442024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
73452024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
73462024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
73472024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
73482024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
73492024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
73502024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
73512024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
73522024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73532024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
73542024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73552024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73562024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
73572024-11-09T02:51:33.010ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
73582024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73592024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
73602024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
73612024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
73622024-11-09T02:51:33.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
73632024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73642024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
73652024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
73662024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73672024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
73682024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
73692024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
73702024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
73712024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73722024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73732024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
73742024-11-09T02:51:33.010ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:41:33.010719582 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
73752024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
73762024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
73772024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
73782024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
73792024-11-09T02:51:33.010ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
73802024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
73812024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73822024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
73832024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
73842024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
73852024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
73862024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73872024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73882024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
73892024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73902024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
73912024-11-09T02:51:33.010ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
73922024-11-09T02:51:33.010ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 11.98\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
73932024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
73942024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73952024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73962024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
73972024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
73982024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
73992024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74002024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74012024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74022024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74032024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74042024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74052024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
74062024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74072024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74082024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
74092024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
74102024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.671\u{b5}s iteration = 11 status = {"errors":[],"records_set_to_done":[]}
74112024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74122024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
74132024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.45\u{b5}s iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
74142024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74152024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
74162024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74172024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
74182024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
74192024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
74202024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
74212024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.56\u{b5}s iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74222024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.62\u{b5}s iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74232024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
74242024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74252024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74262024-11-09T02:51:33.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 350289267 } })
74272024-11-09T02:51:33.011ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 350329348 } })
74282024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
74292024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
74302024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
74312024-11-09T02:51:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.42941ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
74322024-11-09T02:51:33.012ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
74332024-11-09T02:51:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.355418ms iteration = 7 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
74342024-11-09T02:51:33.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 352826680 } })
74352024-11-09T02:51:33.014ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
74362024-11-09T02:51:33.014ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 353220218 } })
74372024-11-09T02:51:33.014ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
74382024-11-09T02:51:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.912561ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
74392024-11-09T02:51:33.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
74402024-11-09T02:51:33.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74412024-11-09T02:51:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
74422024-11-09T02:51:33.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74432024-11-09T02:51:33.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74442024-11-09T02:51:33.016ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74452024-11-09T02:51:33.016ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74462024-11-09T02:51:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74472024-11-09T02:51:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74482024-11-09T02:51:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
74492024-11-09T02:51:33.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74502024-11-09T02:51:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74512024-11-09T02:51:33.022ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74522024-11-09T02:51:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74532024-11-09T02:51:33.022ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74542024-11-09T02:51:33.023ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74552024-11-09T02:51:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74562024-11-09T02:51:33.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74572024-11-09T02:51:33.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74582024-11-09T02:51:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74592024-11-09T02:51:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
74602024-11-09T02:51:33.025ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
74612024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
74622024-11-09T02:51:33.026ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:41:33.010719582 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
74632024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.383508ms iteration = 6 status = {"expiration":"2024-11-09T02:41:33.010719582Z","pruned":[]}
74642024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74652024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
74662024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
74672024-11-09T02:51:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
74682024-11-09T02:51:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
74692024-11-09T02:51:33.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74702024-11-09T02:51:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74712024-11-09T02:51:33.031ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74722024-11-09T02:51:33.031ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74732024-11-09T02:51:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74742024-11-09T02:51:33.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74752024-11-09T02:51:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74762024-11-09T02:51:33.033ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74772024-11-09T02:51:33.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
74782024-11-09T02:51:33.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
74792024-11-09T02:51:33.034ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 22.959744ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
74802024-11-09T02:51:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
74812024-11-09T02:51:33.035ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74822024-11-09T02:51:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
74832024-11-09T02:51:33.038ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
74842024-11-09T02:51:33.038ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
74852024-11-09T02:51:33.038ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
74862024-11-09T02:51:33.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
74872024-11-09T02:51:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
74882024-11-09T02:51:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74892024-11-09T02:51:33.042ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
74902024-11-09T02:51:33.042ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74912024-11-09T02:51:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
74922024-11-09T02:51:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74932024-11-09T02:51:33.050ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74942024-11-09T02:51:33.051ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74952024-11-09T02:51:33.053ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74962024-11-09T02:51:33.053ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74972024-11-09T02:51:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74982024-11-09T02:51:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
74992024-11-09T02:51:33.055ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75002024-11-09T02:51:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75012024-11-09T02:51:33.056ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75022024-11-09T02:51:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75032024-11-09T02:51:33.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75042024-11-09T02:51:33.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75052024-11-09T02:51:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75062024-11-09T02:51:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
75072024-11-09T02:51:33.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75082024-11-09T02:51:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75092024-11-09T02:51:33.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
75102024-11-09T02:51:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
75112024-11-09T02:51:33.073ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75122024-11-09T02:51:33.073ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
75132024-11-09T02:51:33.073ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75142024-11-09T02:51:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75152024-11-09T02:51:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.413ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
75162024-11-09T02:51:33.074ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
75172024-11-09T02:51:33.074ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
75182024-11-09T02:51:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 62.676695ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
75192024-11-09T02:51:33.079ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75202024-11-09T02:51:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75212024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
75222024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
75232024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
75242024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75252024-11-09T02:51:33.083ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
75262024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 72.59323ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
75272024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75282024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
75292024-11-09T02:51:33.083ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
75302024-11-09T02:51:33.083ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 73.10278ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
75312024-11-09T02:51:33.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75322024-11-09T02:51:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75332024-11-09T02:51:33.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75342024-11-09T02:51:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75352024-11-09T02:51:33.088ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75362024-11-09T02:51:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75372024-11-09T02:51:33.089ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75382024-11-09T02:51:33.091ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
75392024-11-09T02:51:33.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
75402024-11-09T02:51:33.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
75412024-11-09T02:51:33.131ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
75422024-11-09T02:51:33.131ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 121.080192ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
75432024-11-09T02:51:33.150ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
75442024-11-09T02:51:33.150ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
75452024-11-09T02:51:33.151ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f0f7c7ce-1992-468f-83b4-d8bb519cd379", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:32 GMT"} })
75462024-11-09T02:51:33.151ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
75472024-11-09T02:51:33.153ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
75482024-11-09T02:51:33.200ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
75492024-11-09T02:51:33.223ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75502024-11-09T02:51:33.225ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75512024-11-09T02:51:33.225ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75522024-11-09T02:51:33.227ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ec31b32a-819a-4c97-8f3d-7dc03b793608", "content-length": "372", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
75532024-11-09T02:51:33.227ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75542024-11-09T02:51:33.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75552024-11-09T02:51:33.231ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1196, tv_nsec: 570534179 } })
75562024-11-09T02:51:33.232ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
75572024-11-09T02:51:33.232ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75582024-11-09T02:51:33.234ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75592024-11-09T02:51:33.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75602024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
75612024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75622024-11-09T02:51:33.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75632024-11-09T02:51:33.240ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
75642024-11-09T02:51:33.240ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
75652024-11-09T02:51:33.240ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75662024-11-09T02:51:33.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75672024-11-09T02:51:33.247ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75682024-11-09T02:51:33.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75692024-11-09T02:51:33.250ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75702024-11-09T02:51:33.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75712024-11-09T02:51:33.251ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75722024-11-09T02:51:33.260ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
75732024-11-09T02:51:33.260ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
75742024-11-09T02:51:33.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
75752024-11-09T02:51:33.263ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 252.670962ms iteration = 11 status = 0
75762024-11-09T02:51:33.301ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 291.121817ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
75772024-11-09T02:51:33.302ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75782024-11-09T02:51:33.305ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
75792024-11-09T02:51:33.305ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
75802024-11-09T02:51:33.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
75812024-11-09T02:51:33.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
75822024-11-09T02:51:33.307ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
75832024-11-09T02:51:33.307ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
75842024-11-09T02:51:33.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
75852024-11-09T02:51:33.308ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
75862024-11-09T02:51:33.308ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75872024-11-09T02:51:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
75882024-11-09T02:51:33.308ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75892024-11-09T02:51:33.312ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
75902024-11-09T02:51:33.312ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
75912024-11-09T02:51:33.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
75922024-11-09T02:51:33.313ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
75932024-11-09T02:51:33.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
75942024-11-09T02:51:33.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
75952024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
75962024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
75972024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
75982024-11-09T02:51:33.316ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 305.482614ms iteration = 7 status = {"generation":1}
75992024-11-09T02:51:33.321ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76002024-11-09T02:51:33.326ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
76012024-11-09T02:51:33.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76022024-11-09T02:51:33.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76032024-11-09T02:51:33.336ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
76042024-11-09T02:51:33.336ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 325.734231ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
76052024-11-09T02:51:33.344ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
76062024-11-09T02:51:33.344ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
76072024-11-09T02:51:33.345ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "887aa27b-eb0e-414e-84d6-c6080947a789", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
76082024-11-09T02:51:33.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76092024-11-09T02:51:33.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76102024-11-09T02:51:33.353ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76112024-11-09T02:51:33.353ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76122024-11-09T02:51:33.357ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
76132024-11-09T02:51:33.357ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76142024-11-09T02:51:33.359ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76152024-11-09T02:51:33.359ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87dd0f45-be9b-46b5-be0a-51a0992c2849", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
76162024-11-09T02:51:33.359ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76172024-11-09T02:51:33.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76182024-11-09T02:51:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76192024-11-09T02:51:33.361ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
76202024-11-09T02:51:33.362ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
76212024-11-09T02:51:33.362ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
76222024-11-09T02:51:33.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
76232024-11-09T02:51:33.365ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
76242024-11-09T02:51:33.365ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
76252024-11-09T02:51:33.365ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76262024-11-09T02:51:33.365ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
76272024-11-09T02:51:33.365ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
76282024-11-09T02:51:33.365ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 355.252822ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
76292024-11-09T02:51:33.365ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76302024-11-09T02:51:33.365ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76312024-11-09T02:51:33.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76322024-11-09T02:51:33.366ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3bb587ee-f75e-4f3d-a990-c8d2a151f48a", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
76332024-11-09T02:51:33.368ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76342024-11-09T02:51:33.371ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.921229ms iteration = 12 status = {}
76352024-11-09T02:51:33.371ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
76362024-11-09T02:51:33.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
76372024-11-09T02:51:33.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
76382024-11-09T02:51:33.373ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
76392024-11-09T02:51:33.373ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4c4f6da8-a7e1-40d2-83e3-a472fd725be8", "content-length": "1", "date": "Sat, 09 Nov 2024 02:51:32 GMT"} })
76402024-11-09T02:51:33.374ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
76412024-11-09T02:51:33.374ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
76422024-11-09T02:51:33.374ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
76432024-11-09T02:51:33.374ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 363.868489ms iteration = 7 status = {"generation":2}
76442024-11-09T02:51:33.376ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
76452024-11-09T02:51:33.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
76462024-11-09T02:51:33.379ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 368.492795ms iteration = 11 status = null
76472024-11-09T02:51:33.381ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76482024-11-09T02:51:33.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76492024-11-09T02:51:33.383ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76502024-11-09T02:51:33.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76512024-11-09T02:51:33.385ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76522024-11-09T02:51:33.390ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
76532024-11-09T02:51:33.390ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76542024-11-09T02:51:33.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76552024-11-09T02:51:33.393ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
76562024-11-09T02:51:33.393ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
76572024-11-09T02:51:33.394ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d77c2b6c-bd13-4ea5-b641-e1d8aa719517", "content-length": "26", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
76582024-11-09T02:51:33.394ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
76592024-11-09T02:51:33.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76602024-11-09T02:51:33.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76612024-11-09T02:51:33.396ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
76622024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76632024-11-09T02:51:33.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76642024-11-09T02:51:33.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76652024-11-09T02:51:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76662024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76672024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76682024-11-09T02:51:33.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76692024-11-09T02:51:33.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76702024-11-09T02:51:33.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76712024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76722024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76732024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76742024-11-09T02:51:33.404ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76752024-11-09T02:51:33.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76762024-11-09T02:51:33.405ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76772024-11-09T02:51:33.406ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76782024-11-09T02:51:33.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76792024-11-09T02:51:33.408ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
76802024-11-09T02:51:33.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
76812024-11-09T02:51:33.408ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
76822024-11-09T02:51:33.410ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
76832024-11-09T02:51:33.410ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 400.256951ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
76842024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76852024-11-09T02:51:33.412ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 401.546428ms iteration = 13 status = {"physical_disks_added":0}
76862024-11-09T02:51:33.417ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
76872024-11-09T02:51:33.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76882024-11-09T02:51:33.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76892024-11-09T02:51:33.418ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76902024-11-09T02:51:33.419ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
76912024-11-09T02:51:33.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76922024-11-09T02:51:33.421ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76932024-11-09T02:51:33.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76942024-11-09T02:51:33.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76952024-11-09T02:51:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76962024-11-09T02:51:33.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76972024-11-09T02:51:33.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76982024-11-09T02:51:33.431ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76992024-11-09T02:51:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77002024-11-09T02:51:33.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77012024-11-09T02:51:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77022024-11-09T02:51:33.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77032024-11-09T02:51:33.441ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
77042024-11-09T02:51:33.441ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77052024-11-09T02:51:33.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77062024-11-09T02:51:33.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77072024-11-09T02:51:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77082024-11-09T02:51:33.448ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
77092024-11-09T02:51:33.449ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2d4829f5-916c-4d53-866f-92a281f79400", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77102024-11-09T02:51:33.449ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77112024-11-09T02:51:33.451ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "96eaead1-f9b4-4897-ab51-71bc98bc8500", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77122024-11-09T02:51:33.451ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77132024-11-09T02:51:33.453ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
77142024-11-09T02:51:33.453ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 442.581116ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
77152024-11-09T02:51:33.481ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 471.013503ms iteration = 11 status = {}
77162024-11-09T02:51:33.482ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77172024-11-09T02:51:33.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77182024-11-09T02:51:33.566ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
77192024-11-09T02:51:33.566ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd6ce594-413c-4693-8546-72411f92c1e9", "content-length": "691", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
77202024-11-09T02:51:33.566ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
77212024-11-09T02:51:33.566ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
77222024-11-09T02:51:33.566ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
77232024-11-09T02:51:33.567ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77242024-11-09T02:51:33.569ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 558.760567ms iteration = 11 status = {}
77252024-11-09T02:51:33.571ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
77262024-11-09T02:51:33.571ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77272024-11-09T02:51:33.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77282024-11-09T02:51:33.577ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77292024-11-09T02:51:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77302024-11-09T02:51:33.580ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77312024-11-09T02:51:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77322024-11-09T02:51:33.581ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77332024-11-09T02:51:33.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77342024-11-09T02:51:33.583ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77352024-11-09T02:51:33.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77362024-11-09T02:51:33.586ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77372024-11-09T02:51:33.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77382024-11-09T02:51:33.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77392024-11-09T02:51:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77402024-11-09T02:51:33.589ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77412024-11-09T02:51:33.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77422024-11-09T02:51:33.591ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77432024-11-09T02:51:33.596ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
77442024-11-09T02:51:33.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77452024-11-09T02:51:33.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77462024-11-09T02:51:33.598ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77472024-11-09T02:51:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77482024-11-09T02:51:33.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77492024-11-09T02:51:33.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77502024-11-09T02:51:33.600ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77512024-11-09T02:51:33.603ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
77522024-11-09T02:51:33.604ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "1d819c8f-13e0-4f52-a207-c636a06c3b80", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77532024-11-09T02:51:33.604ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77542024-11-09T02:51:33.605ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
77552024-11-09T02:51:33.606ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77562024-11-09T02:51:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77572024-11-09T02:51:33.606ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "9aa7b509-8e8c-4a1f-9092-6852cd5cb50c", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77582024-11-09T02:51:33.606ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77592024-11-09T02:51:33.608ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "fc96e872-3b9a-4f4e-ae6a-ee02a787b566", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77602024-11-09T02:51:33.608ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77612024-11-09T02:51:33.611ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
77622024-11-09T02:51:33.611ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 601.058541ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
77632024-11-09T02:51:33.616ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
77642024-11-09T02:51:33.617ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77652024-11-09T02:51:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77662024-11-09T02:51:33.618ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77672024-11-09T02:51:33.620ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
77682024-11-09T02:51:33.620ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
77692024-11-09T02:51:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
77702024-11-09T02:51:33.622ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
77712024-11-09T02:51:33.622ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
77722024-11-09T02:51:33.622ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
77732024-11-09T02:51:33.676ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77742024-11-09T02:51:33.676ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77752024-11-09T02:51:33.678ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
77762024-11-09T02:51:33.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77772024-11-09T02:51:33.678ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77782024-11-09T02:51:33.689ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
77792024-11-09T02:51:33.689ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "58461bd4-60aa-4157-a36e-bbea3e7adc12", "content-length": "134", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
77802024-11-09T02:51:33.689ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
77812024-11-09T02:51:33.689ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
77822024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
77832024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
77842024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77852024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77862024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77872024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77882024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
77892024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
77902024-11-09T02:51:33.690ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
77912024-11-09T02:51:33.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77922024-11-09T02:51:33.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77932024-11-09T02:51:33.693ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
77942024-11-09T02:51:33.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4daa652d-b238-4cbc-bfef-642f5d6a56cb", "content-length": "2", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
77952024-11-09T02:51:33.693ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
77962024-11-09T02:51:33.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "72e620e3-b11e-4ae7-bbd3-d4c67047d868", "content-length": "52", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
77972024-11-09T02:51:33.693ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
77982024-11-09T02:51:33.693ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
77992024-11-09T02:51:33.758ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
78002024-11-09T02:51:33.758ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
78012024-11-09T02:51:33.758ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78022024-11-09T02:51:33.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78032024-11-09T02:51:33.760ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
78042024-11-09T02:51:33.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
78052024-11-09T02:51:33.762ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78062024-11-09T02:51:33.765ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
78072024-11-09T02:51:33.796ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
78082024-11-09T02:51:33.796ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "a4480aa3-ef14-43d6-a476-02516f0157f0", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
78092024-11-09T02:51:33.798ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
78102024-11-09T02:51:33.798ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 788.338402ms
78112024-11-09T02:51:33.798ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 788.350191ms iteration = 2 status = {}
78122024-11-09T02:51:33.838ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "da0b1a34-d133-43a3-b47a-9ce763ff26b9", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
78132024-11-09T02:51:33.838ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
78142024-11-09T02:51:33.838ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
78152024-11-09T02:51:33.843ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb07f68d-f711-4bdf-937d-45cf217f597a", "content-length": "682", "date": "Sat, 09 Nov 2024 02:51:33 GMT"} })
78162024-11-09T02:51:33.843ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78172024-11-09T02:51:33.844ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78182024-11-09T02:51:33.847ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78192024-11-09T02:51:33.847ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78202024-11-09T02:51:33.851ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78212024-11-09T02:51:33.851ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78222024-11-09T02:51:33.853ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78232024-11-09T02:51:33.854ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78242024-11-09T02:51:33.861ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 850.366034ms iteration = 11 status = {}
78252024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
78262024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78272024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
78282024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78292024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78302024-11-09T02:51:43.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78312024-11-09T02:51:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78322024-11-09T02:51:43.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78332024-11-09T02:51:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78342024-11-09T02:51:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78352024-11-09T02:51:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78362024-11-09T02:51:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78372024-11-09T02:51:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78382024-11-09T02:51:43.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78392024-11-09T02:51:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78402024-11-09T02:51:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
78412024-11-09T02:51:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78422024-11-09T02:51:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78432024-11-09T02:51:43.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
78442024-11-09T02:51:43.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.6931ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
78452024-11-09T02:51:43.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.498335ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78462024-11-09T02:51:45.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1378 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 73b13655-b122-4af1-ba93-4a1d10fb412c response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
78472024-11-09T02:51:46.739ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33138
78482024-11-09T02:51:46.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33138 req_id = c193ef3c-fd6b-4bd1-8e25-88ce78a5abf7 roles = RoleSet { roles: {} } uri = /metrics/producers
78492024-11-09T02:51:46.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33138 req_id = c193ef3c-fd6b-4bd1-8e25-88ce78a5abf7 resource = Database result = Ok(()) uri = /metrics/producers
78502024-11-09T02:51:46.773ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
78512024-11-09T02:51:46.773ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33516 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33138 req_id = c193ef3c-fd6b-4bd1-8e25-88ce78a5abf7 response_code = 201 uri = /metrics/producers
78522024-11-09T02:51:48.437ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:38865
78532024-11-09T02:51:48.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38865 req_id = 7ee282c3-da8d-4353-a64d-5abaca44757a roles = RoleSet { roles: {} } uri = /metrics/producers
78542024-11-09T02:51:48.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38865 req_id = 7ee282c3-da8d-4353-a64d-5abaca44757a resource = Database result = Ok(()) uri = /metrics/producers
78552024-11-09T02:51:48.478ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
78562024-11-09T02:51:48.478ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 40768 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:38865 req_id = 7ee282c3-da8d-4353-a64d-5abaca44757a response_code = 201 uri = /metrics/producers
78572024-11-09T02:51:52.374ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:62797
78582024-11-09T02:51:52.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62797 req_id = 1123c13e-bb28-4cf4-9b2c-3a33094e156b roles = RoleSet { roles: {} } uri = /metrics/producers
78592024-11-09T02:51:52.374ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62797 req_id = 1123c13e-bb28-4cf4-9b2c-3a33094e156b resource = Database result = Ok(()) uri = /metrics/producers
78602024-11-09T02:51:52.413ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
78612024-11-09T02:51:52.413ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39464 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:62797 req_id = 1123c13e-bb28-4cf4-9b2c-3a33094e156b response_code = 201 uri = /metrics/producers
78622024-11-09T02:51:52.673ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43061
78632024-11-09T02:51:52.673ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43061 req_id = 24560e46-9525-4be7-806b-e89b5f79d0ff roles = RoleSet { roles: {} } uri = /metrics/producers
78642024-11-09T02:51:52.673ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43061 req_id = 24560e46-9525-4be7-806b-e89b5f79d0ff resource = Database result = Ok(()) uri = /metrics/producers
78652024-11-09T02:51:52.712ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
78662024-11-09T02:51:52.712ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38869 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43061 req_id = 24560e46-9525-4be7-806b-e89b5f79d0ff response_code = 201 uri = /metrics/producers
78672024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
78682024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
78692024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78702024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78712024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78722024-11-09T02:51:53.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78732024-11-09T02:51:53.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78742024-11-09T02:51:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78752024-11-09T02:51:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78762024-11-09T02:51:53.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.119665ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78772024-11-09T02:51:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78782024-11-09T02:51:53.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78792024-11-09T02:51:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78802024-11-09T02:51:53.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78812024-11-09T02:51:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78822024-11-09T02:51:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78832024-11-09T02:51:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
78842024-11-09T02:51:53.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78852024-11-09T02:51:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78862024-11-09T02:51:53.030ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
78872024-11-09T02:51:53.030ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.452282ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
78882024-11-09T02:51:57.848ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:42112
78892024-11-09T02:51:57.848ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42112 req_id = ebea75e1-a64f-430c-a2bc-b5f5fd73da49 roles = RoleSet { roles: {} } uri = /metrics/producers
78902024-11-09T02:51:57.848ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42112 req_id = ebea75e1-a64f-430c-a2bc-b5f5fd73da49 resource = Database result = Ok(()) uri = /metrics/producers
78912024-11-09T02:51:57.857ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
78922024-11-09T02:51:57.857ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9496 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:42112 req_id = ebea75e1-a64f-430c-a2bc-b5f5fd73da49 response_code = 201 uri = /metrics/producers
78932024-11-09T02:52:00.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = a69daaec-e308-467b-a1a5-5b9e8f5dd64b response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
78942024-11-09T02:52:02.000ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:39360
78952024-11-09T02:52:02.000ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39360 req_id = fac9dbbf-28f6-418c-b248-d3aeec29eabc roles = RoleSet { roles: {} } uri = /metrics/producers
78962024-11-09T02:52:02.001ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39360 req_id = fac9dbbf-28f6-418c-b248-d3aeec29eabc resource = Database result = Ok(()) uri = /metrics/producers
78972024-11-09T02:52:02.010ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
78982024-11-09T02:52:02.010ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9949 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:39360 req_id = fac9dbbf-28f6-418c-b248-d3aeec29eabc response_code = 201 uri = /metrics/producers
78992024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
79002024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79012024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
79022024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79032024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
79042024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
79052024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
79062024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
79072024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79082024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79092024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
79102024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
79112024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79122024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
79132024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79142024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
79152024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
79162024-11-09T02:52:03.010ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
79172024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79182024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79192024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
79202024-11-09T02:52:03.010ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
79212024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79222024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
79232024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
79242024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
79252024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79262024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79272024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79282024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
79292024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79302024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79312024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79322024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
79332024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79342024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79352024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79362024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79372024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79382024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
79392024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
79402024-11-09T02:52:03.011ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.92\u{b5}s iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
79412024-11-09T02:52:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
79422024-11-09T02:52:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.82\u{b5}s iteration = 12 status = {"errors":[],"records_set_to_done":[]}
79432024-11-09T02:52:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
79442024-11-09T02:52:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.121\u{b5}s iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
79452024-11-09T02:52:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.771\u{b5}s iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
79462024-11-09T02:52:03.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79472024-11-09T02:52:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79482024-11-09T02:52:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.234468ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
79492024-11-09T02:52:03.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79502024-11-09T02:52:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79512024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
79522024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79532024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
79542024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
79552024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79562024-11-09T02:52:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
79572024-11-09T02:52:03.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79582024-11-09T02:52:03.018ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79592024-11-09T02:52:03.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 357656600 } })
79602024-11-09T02:52:03.019ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79612024-11-09T02:52:03.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
79622024-11-09T02:52:03.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79632024-11-09T02:52:03.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79642024-11-09T02:52:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79652024-11-09T02:52:03.020ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
79662024-11-09T02:52:03.020ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
79672024-11-09T02:52:03.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
79682024-11-09T02:52:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
79692024-11-09T02:52:03.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79702024-11-09T02:52:03.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 360298194 } })
79712024-11-09T02:52:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79722024-11-09T02:52:03.021ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79732024-11-09T02:52:03.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
79742024-11-09T02:52:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79752024-11-09T02:52:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
79762024-11-09T02:52:03.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79772024-11-09T02:52:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79782024-11-09T02:52:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
79792024-11-09T02:52:03.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79802024-11-09T02:52:03.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79812024-11-09T02:52:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79822024-11-09T02:52:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79832024-11-09T02:52:03.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79842024-11-09T02:52:03.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79852024-11-09T02:52:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79862024-11-09T02:52:03.028ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
79872024-11-09T02:52:03.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79882024-11-09T02:52:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79892024-11-09T02:52:03.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
79902024-11-09T02:52:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
79912024-11-09T02:52:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79922024-11-09T02:52:03.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79932024-11-09T02:52:03.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1226, tv_nsec: 370059416 } })
79942024-11-09T02:52:03.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
79952024-11-09T02:52:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
79962024-11-09T02:52:03.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
79972024-11-09T02:52:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
79982024-11-09T02:52:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
79992024-11-09T02:52:03.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80002024-11-09T02:52:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80012024-11-09T02:52:03.046ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 35.638876ms iteration = 14 status = {"physical_disks_added":0}
80022024-11-09T02:52:03.052ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
80032024-11-09T02:52:03.052ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 41.878236ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
80042024-11-09T02:52:03.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80052024-11-09T02:52:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
80062024-11-09T02:52:03.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80072024-11-09T02:52:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80082024-11-09T02:52:03.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.175689ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80092024-11-09T02:52:03.064ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
80102024-11-09T02:52:03.064ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 54.16266ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
80112024-11-09T02:52:03.065ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80122024-11-09T02:52:03.065ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
80132024-11-09T02:52:03.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80142024-11-09T02:52:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
80152024-11-09T02:52:03.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
80162024-11-09T02:52:03.103ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80172024-11-09T02:52:03.103ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d2a09c2-974e-4341-80ef-f214d7f75c6c", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
80182024-11-09T02:52:03.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80192024-11-09T02:52:03.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80202024-11-09T02:52:03.106ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
80212024-11-09T02:52:03.106ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80222024-11-09T02:52:03.107ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29d20ef5-f01d-4187-94e6-e32238fc31be", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
80232024-11-09T02:52:03.107ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80242024-11-09T02:52:03.109ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
80252024-11-09T02:52:03.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80262024-11-09T02:52:03.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80272024-11-09T02:52:03.121ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
80282024-11-09T02:52:03.121ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80292024-11-09T02:52:03.121ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "114c332e-6063-40bf-926e-c0b5f03ad876", "content-length": "372", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
80302024-11-09T02:52:03.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80312024-11-09T02:52:03.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80322024-11-09T02:52:03.123ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 112.456374ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
80332024-11-09T02:52:03.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80342024-11-09T02:52:03.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80352024-11-09T02:52:03.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80362024-11-09T02:52:03.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
80372024-11-09T02:52:03.132ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80382024-11-09T02:52:03.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
80392024-11-09T02:52:03.134ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 123.412181ms iteration = 12 status = 0
80402024-11-09T02:52:03.139ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
80412024-11-09T02:52:03.139ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
80422024-11-09T02:52:03.140ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7dbf6c3e-3260-46a7-8dc6-fa0cc8ace161", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
80432024-11-09T02:52:03.140ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
80442024-11-09T02:52:03.143ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
80452024-11-09T02:52:03.167ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
80462024-11-09T02:52:03.167ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
80472024-11-09T02:52:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.569336ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
80482024-11-09T02:52:03.175ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
80492024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
80502024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b28b3567-b9f3-45e8-bc45-e2c7c588bfdc", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
80512024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80522024-11-09T02:52:03.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80532024-11-09T02:52:03.183ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 172.455164ms iteration = 12 status = {}
80542024-11-09T02:52:03.187ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
80552024-11-09T02:52:03.187ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80562024-11-09T02:52:03.187ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fe1ffa0-53f7-4d0d-a625-79be38d9b285", "content-length": "1", "date": "Sat, 09 Nov 2024 02:52:02 GMT"} })
80572024-11-09T02:52:03.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80582024-11-09T02:52:03.190ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80592024-11-09T02:52:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
80602024-11-09T02:52:03.193ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.271257ms iteration = 12 status = null
80612024-11-09T02:52:03.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80622024-11-09T02:52:03.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
80632024-11-09T02:52:03.198ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
80642024-11-09T02:52:03.198ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
80652024-11-09T02:52:03.198ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6979582c-d766-4ab6-8bdc-e5486542f7a9", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
80662024-11-09T02:52:03.201ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 190.15241ms iteration = 13 status = {}
80672024-11-09T02:52:03.263ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80682024-11-09T02:52:03.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80692024-11-09T02:52:03.265ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80702024-11-09T02:52:03.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80712024-11-09T02:52:03.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80722024-11-09T02:52:03.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80732024-11-09T02:52:03.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80742024-11-09T02:52:03.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
80752024-11-09T02:52:03.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80762024-11-09T02:52:03.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
80772024-11-09T02:52:03.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80782024-11-09T02:52:03.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80792024-11-09T02:52:03.278ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
80802024-11-09T02:52:03.278ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80812024-11-09T02:52:03.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80822024-11-09T02:52:03.291ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
80832024-11-09T02:52:03.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e87aa99-babe-4445-a854-c2cc9c94c9fd", "content-length": "134", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
80842024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
80852024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
80862024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
80872024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
80882024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80892024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80902024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80912024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80922024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
80932024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
80942024-11-09T02:52:03.292ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
80952024-11-09T02:52:03.293ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80962024-11-09T02:52:03.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
80972024-11-09T02:52:03.298ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
80982024-11-09T02:52:03.299ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "ceb26a8c-6302-48a7-bb12-078f71a79af7", "content-length": "2", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
80992024-11-09T02:52:03.299ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
81002024-11-09T02:52:03.299ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d111a979-22f6-4d5c-9d51-a0003719b556", "content-length": "52", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
81012024-11-09T02:52:03.299ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
81022024-11-09T02:52:03.299ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
81032024-11-09T02:52:03.308ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
81042024-11-09T02:52:03.408ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6fd715c7-139f-499b-a9a1-b80a46ace8f6", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
81052024-11-09T02:52:03.408ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
81062024-11-09T02:52:03.408ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
81072024-11-09T02:52:03.409ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7bb882c6-7ca5-496e-9ce6-dc65ef87578f", "content-length": "682", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
81082024-11-09T02:52:03.409ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81092024-11-09T02:52:03.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81102024-11-09T02:52:03.409ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "852a41a4-8ac1-4787-8abe-98a84b479f28", "content-length": "691", "date": "Sat, 09 Nov 2024 02:52:03 GMT"} })
81112024-11-09T02:52:03.409ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
81122024-11-09T02:52:03.409ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
81132024-11-09T02:52:03.409ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
81142024-11-09T02:52:03.411ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 400.284812ms iteration = 12 status = {}
81152024-11-09T02:52:03.413ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81162024-11-09T02:52:03.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81172024-11-09T02:52:03.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81182024-11-09T02:52:03.417ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81192024-11-09T02:52:03.419ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81202024-11-09T02:52:03.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81212024-11-09T02:52:03.426ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 415.64721ms iteration = 12 status = {}
81222024-11-09T02:52:10.060ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
81232024-11-09T02:52:10.060ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
81242024-11-09T02:52:10.090ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
81252024-11-09T02:52:10.090ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:60098
81262024-11-09T02:52:10.090ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60098 req_id = 91bb3904-3c83-46a9-a6e1-994dbc8a1758 roles = RoleSet { roles: {} } uri = /metrics/producers
81272024-11-09T02:52:10.091ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60098 req_id = 91bb3904-3c83-46a9-a6e1-994dbc8a1758 resource = Database result = Ok(()) uri = /metrics/producers
81282024-11-09T02:52:10.099ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
81292024-11-09T02:52:10.100ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9098 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:60098 req_id = 91bb3904-3c83-46a9-a6e1-994dbc8a1758 response_code = 201 uri = /metrics/producers
81302024-11-09T02:52:10.100ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "91bb3904-3c83-46a9-a6e1-994dbc8a1758", "content-length": "41", "date": "Sat, 09 Nov 2024 02:52:10 GMT"} })
81312024-11-09T02:52:10.102ZDEBGnexus (producer-registration-task): registered with nexus successfully
81322024-11-09T02:52:10.102ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
81332024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
81342024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
81352024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81362024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81372024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81382024-11-09T02:52:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81392024-11-09T02:52:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81402024-11-09T02:52:13.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81412024-11-09T02:52:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81422024-11-09T02:52:13.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.109356ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81432024-11-09T02:52:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81442024-11-09T02:52:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81452024-11-09T02:52:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81462024-11-09T02:52:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81472024-11-09T02:52:13.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81482024-11-09T02:52:13.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81492024-11-09T02:52:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
81502024-11-09T02:52:13.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81512024-11-09T02:52:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81522024-11-09T02:52:13.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
81532024-11-09T02:52:13.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.981243ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
81542024-11-09T02:52:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1211 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 93e426f7-4fd3-4e99-919f-57c6d7d0d427 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
81552024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
81562024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
81572024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81582024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81592024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81602024-11-09T02:52:23.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81612024-11-09T02:52:23.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81622024-11-09T02:52:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
81632024-11-09T02:52:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81642024-11-09T02:52:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81652024-11-09T02:52:23.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81662024-11-09T02:52:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81672024-11-09T02:52:23.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.8731ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
81682024-11-09T02:52:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81692024-11-09T02:52:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81702024-11-09T02:52:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81712024-11-09T02:52:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
81722024-11-09T02:52:23.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81732024-11-09T02:52:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81742024-11-09T02:52:23.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
81752024-11-09T02:52:23.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.548975ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
81762024-11-09T02:52:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1227 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 462a6d7d-5464-4749-899f-079fe5ec49c2 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
81772024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
81782024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
81792024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
81802024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
81812024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
81822024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
81832024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
81842024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
81852024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
81862024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
81872024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
81882024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
81892024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
81902024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
81912024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81922024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81932024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
81942024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81952024-11-09T02:52:33.011ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
81962024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81972024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
81982024-11-09T02:52:33.011ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:42:33.011566670 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
81992024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
82002024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
82012024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82022024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
82032024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82042024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
82052024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
82062024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82072024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
82082024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82092024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
82102024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
82112024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
82122024-11-09T02:52:33.011ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
82132024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
82142024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
82152024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
82162024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
82172024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82182024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82192024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
82202024-11-09T02:52:33.011ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
82212024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.56\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
82222024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
82232024-11-09T02:52:33.011ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
82242024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
82252024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
82262024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82272024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
82282024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82292024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
82302024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 13.93\u{b5}s iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
82312024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
82322024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
82332024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
82342024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.63\u{b5}s iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
82352024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
82362024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
82372024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
82382024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.561\u{b5}s iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
82392024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
82402024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.05\u{b5}s iteration = 13 status = {"errors":[],"records_set_to_done":[]}
82412024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82422024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
82432024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82442024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82452024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82462024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82472024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
82482024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82492024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82502024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82512024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
82522024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82532024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82542024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82552024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82562024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82572024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
82582024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
82592024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
82602024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82612024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
82622024-11-09T02:52:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 350923731 } })
82632024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82642024-11-09T02:52:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 350975882 } })
82652024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82662024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82672024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82682024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82692024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82702024-11-09T02:52:33.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82712024-11-09T02:52:33.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
82722024-11-09T02:52:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.629723ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
82732024-11-09T02:52:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82742024-11-09T02:52:33.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
82752024-11-09T02:52:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.614043ms iteration = 8 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
82762024-11-09T02:52:33.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 353493994 } })
82772024-11-09T02:52:33.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
82782024-11-09T02:52:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.88059ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
82792024-11-09T02:52:33.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82802024-11-09T02:52:33.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82812024-11-09T02:52:33.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82822024-11-09T02:52:33.017ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82832024-11-09T02:52:33.017ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
82842024-11-09T02:52:33.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82852024-11-09T02:52:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82862024-11-09T02:52:33.018ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:42:33.011566670 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
82872024-11-09T02:52:33.018ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 6.685639ms iteration = 7 status = {"expiration":"2024-11-09T02:42:33.011566670Z","pruned":[]}
82882024-11-09T02:52:33.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82892024-11-09T02:52:33.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82902024-11-09T02:52:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82912024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
82922024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82932024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82942024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
82952024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82962024-11-09T02:52:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82972024-11-09T02:52:33.020ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82982024-11-09T02:52:33.020ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82992024-11-09T02:52:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
83002024-11-09T02:52:33.020ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83012024-11-09T02:52:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83022024-11-09T02:52:33.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83032024-11-09T02:52:33.022ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83042024-11-09T02:52:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83052024-11-09T02:52:33.023ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83062024-11-09T02:52:33.024ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83072024-11-09T02:52:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83082024-11-09T02:52:33.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83092024-11-09T02:52:33.025ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.132151ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
83102024-11-09T02:52:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83112024-11-09T02:52:33.026ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83122024-11-09T02:52:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83132024-11-09T02:52:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
83142024-11-09T02:52:33.030ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
83152024-11-09T02:52:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
83162024-11-09T02:52:33.031ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 369472654 } })
83172024-11-09T02:52:33.031ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83182024-11-09T02:52:33.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
83192024-11-09T02:52:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
83202024-11-09T02:52:33.033ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
83212024-11-09T02:52:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
83222024-11-09T02:52:33.033ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83232024-11-09T02:52:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83242024-11-09T02:52:33.036ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83252024-11-09T02:52:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83262024-11-09T02:52:33.038ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83272024-11-09T02:52:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83282024-11-09T02:52:33.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83292024-11-09T02:52:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83302024-11-09T02:52:33.047ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83312024-11-09T02:52:33.051ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83322024-11-09T02:52:33.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83332024-11-09T02:52:33.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83342024-11-09T02:52:33.055ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1256, tv_nsec: 393743886 } })
83352024-11-09T02:52:33.055ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
83362024-11-09T02:52:33.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
83372024-11-09T02:52:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
83382024-11-09T02:52:33.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83392024-11-09T02:52:33.065ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83402024-11-09T02:52:33.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83412024-11-09T02:52:33.065ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83422024-11-09T02:52:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83432024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83442024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83452024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
83462024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83472024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83482024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83492024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
83502024-11-09T02:52:33.068ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
83512024-11-09T02:52:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
83522024-11-09T02:52:33.070ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.980909ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
83532024-11-09T02:52:33.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83542024-11-09T02:52:33.071ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83552024-11-09T02:52:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83562024-11-09T02:52:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83572024-11-09T02:52:33.074ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83582024-11-09T02:52:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83592024-11-09T02:52:33.075ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83602024-11-09T02:52:33.076ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83612024-11-09T02:52:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83622024-11-09T02:52:33.077ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83632024-11-09T02:52:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
83642024-11-09T02:52:33.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
83652024-11-09T02:52:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
83662024-11-09T02:52:33.079ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83672024-11-09T02:52:33.079ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
83682024-11-09T02:52:33.079ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
83692024-11-09T02:52:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83702024-11-09T02:52:33.080ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83712024-11-09T02:52:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
83722024-11-09T02:52:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83732024-11-09T02:52:33.080ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83742024-11-09T02:52:33.082ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83752024-11-09T02:52:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83762024-11-09T02:52:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
83772024-11-09T02:52:33.082ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
83782024-11-09T02:52:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
83792024-11-09T02:52:33.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83802024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83812024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 74.04742ms iteration = 4 status = {"nsuccess":5}
83822024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83832024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83842024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
83852024-11-09T02:52:33.085ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
83862024-11-09T02:52:33.085ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.048421ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
83872024-11-09T02:52:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83882024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
83892024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83902024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83912024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
83922024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
83932024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
83942024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83952024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
83962024-11-09T02:52:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83972024-11-09T02:52:33.091ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83982024-11-09T02:52:33.091ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 79.32891ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83992024-11-09T02:52:33.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 80.695728ms iteration = 13 status = 0
84002024-11-09T02:52:33.095ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
84012024-11-09T02:52:33.095ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
84022024-11-09T02:52:33.095ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
84032024-11-09T02:52:33.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84042024-11-09T02:52:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84052024-11-09T02:52:33.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84062024-11-09T02:52:33.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 86.793574ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84072024-11-09T02:52:33.098ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
84082024-11-09T02:52:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
84092024-11-09T02:52:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84102024-11-09T02:52:33.099ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84112024-11-09T02:52:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84122024-11-09T02:52:33.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84132024-11-09T02:52:33.100ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84142024-11-09T02:52:33.103ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
84152024-11-09T02:52:33.103ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.050812ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
84162024-11-09T02:52:33.105ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
84172024-11-09T02:52:33.105ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
84182024-11-09T02:52:33.105ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 93.397411ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
84192024-11-09T02:52:33.122ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
84202024-11-09T02:52:33.122ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
84212024-11-09T02:52:33.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 110.563135ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
84222024-11-09T02:52:33.123ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
84232024-11-09T02:52:33.123ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
84242024-11-09T02:52:33.123ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
84252024-11-09T02:52:33.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84262024-11-09T02:52:33.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84272024-11-09T02:52:33.142ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84282024-11-09T02:52:33.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84292024-11-09T02:52:33.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
84302024-11-09T02:52:33.218ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84312024-11-09T02:52:33.218ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a07b379-39c5-4751-bc2b-7df93e04ac07", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:32 GMT"} })
84322024-11-09T02:52:33.218ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84332024-11-09T02:52:33.220ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84342024-11-09T02:52:33.254ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 242.396139ms iteration = 15 status = {"physical_disks_added":0}
84352024-11-09T02:52:33.306ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84362024-11-09T02:52:33.317ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
84372024-11-09T02:52:33.321ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
84382024-11-09T02:52:33.321ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84392024-11-09T02:52:33.322ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "302151ae-7bcf-40b3-9339-2e1f8c7c0e4a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:32 GMT"} })
84402024-11-09T02:52:33.322ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84412024-11-09T02:52:33.323ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
84422024-11-09T02:52:33.329ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
84432024-11-09T02:52:33.329ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
84442024-11-09T02:52:33.330ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "42422950-e22f-4c58-8078-c0dc180d31bb", "content-length": "372", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
84452024-11-09T02:52:33.330ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84462024-11-09T02:52:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84472024-11-09T02:52:33.332ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84482024-11-09T02:52:33.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84492024-11-09T02:52:33.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84502024-11-09T02:52:33.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84512024-11-09T02:52:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84522024-11-09T02:52:33.338ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84532024-11-09T02:52:33.338ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84542024-11-09T02:52:33.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84552024-11-09T02:52:33.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84562024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
84572024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
84582024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84592024-11-09T02:52:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84602024-11-09T02:52:33.343ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
84612024-11-09T02:52:33.343ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
84622024-11-09T02:52:33.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
84632024-11-09T02:52:33.370ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
84642024-11-09T02:52:33.370ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
84652024-11-09T02:52:33.370ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e8becf6-ed0f-4ac0-a19f-34fff0628de3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
84662024-11-09T02:52:33.370ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
84672024-11-09T02:52:33.371ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
84682024-11-09T02:52:33.371ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
84692024-11-09T02:52:33.371ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84702024-11-09T02:52:33.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84712024-11-09T02:52:33.372ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
84722024-11-09T02:52:33.373ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84732024-11-09T02:52:33.378ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
84742024-11-09T02:52:33.378ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
84752024-11-09T02:52:33.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
84762024-11-09T02:52:33.381ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
84772024-11-09T02:52:33.381ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
84782024-11-09T02:52:33.381ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
84792024-11-09T02:52:33.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 369.591438ms iteration = 8 status = {"generation":1}
84802024-11-09T02:52:33.382ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84812024-11-09T02:52:33.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
84822024-11-09T02:52:33.386ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
84832024-11-09T02:52:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
84842024-11-09T02:52:33.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84852024-11-09T02:52:33.398ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
84862024-11-09T02:52:33.398ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
84872024-11-09T02:52:33.399ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 387.253493ms iteration = 13 status = {}
84882024-11-09T02:52:33.399ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "273bf59f-acf0-4a43-bd92-450dc7fe30b3", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
84892024-11-09T02:52:33.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84902024-11-09T02:52:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84912024-11-09T02:52:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
84922024-11-09T02:52:33.401ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
84932024-11-09T02:52:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
84942024-11-09T02:52:33.401ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
84952024-11-09T02:52:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
84962024-11-09T02:52:33.403ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
84972024-11-09T02:52:33.403ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
84982024-11-09T02:52:33.403ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
84992024-11-09T02:52:33.403ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 391.769886ms iteration = 8 status = {"generation":2}
85002024-11-09T02:52:33.405ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85012024-11-09T02:52:33.405ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85022024-11-09T02:52:33.408ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
85032024-11-09T02:52:33.408ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
85042024-11-09T02:52:33.409ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "2d495a51-495b-4f16-b27e-ec978915b1f3", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85052024-11-09T02:52:33.410ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 399.416543ms iteration = 14 status = {}
85062024-11-09T02:52:33.435ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
85072024-11-09T02:52:33.435ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 423.597463ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
85082024-11-09T02:52:33.440ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
85092024-11-09T02:52:33.440ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 428.636008ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
85102024-11-09T02:52:33.459ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
85112024-11-09T02:52:33.459ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf8aaa6e-5e46-4b71-acd4-be82c8cc0255", "content-length": "1", "date": "Sat, 09 Nov 2024 02:52:32 GMT"} })
85122024-11-09T02:52:33.461ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85132024-11-09T02:52:33.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85142024-11-09T02:52:33.462ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
85152024-11-09T02:52:33.463ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 451.839708ms iteration = 13 status = null
85162024-11-09T02:52:33.480ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
85172024-11-09T02:52:33.480ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "fba9c894-f6b7-4e61-80c0-37c3614053fb", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85182024-11-09T02:52:33.480ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85192024-11-09T02:52:33.482ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "0fa8254b-84fb-4bc4-a85d-8c7080485bec", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85202024-11-09T02:52:33.482ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85212024-11-09T02:52:33.484ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
85222024-11-09T02:52:33.484ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 472.475293ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
85232024-11-09T02:52:33.527ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
85242024-11-09T02:52:33.527ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d735cc8b-96a9-4bfe-b47f-590d1962a5a3", "content-length": "691", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85252024-11-09T02:52:33.527ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
85262024-11-09T02:52:33.527ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
85272024-11-09T02:52:33.527ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
85282024-11-09T02:52:33.529ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 518.23891ms iteration = 13 status = {}
85292024-11-09T02:52:33.551ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
85302024-11-09T02:52:33.552ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f6933549-87d6-4907-bfef-9d252ff7e3cf", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85312024-11-09T02:52:33.552ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85322024-11-09T02:52:33.554ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "e86f1fa0-a3e8-49f5-ae3d-9d56a967e33f", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85332024-11-09T02:52:33.554ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85342024-11-09T02:52:33.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f15794ee-e86d-4b48-b67e-714b4c74f4a8", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85352024-11-09T02:52:33.556ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85362024-11-09T02:52:33.558ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
85372024-11-09T02:52:33.558ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 546.833741ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
85382024-11-09T02:52:33.603ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85392024-11-09T02:52:33.603ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85402024-11-09T02:52:33.605ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
85412024-11-09T02:52:33.605ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85422024-11-09T02:52:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85432024-11-09T02:52:33.614ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
85442024-11-09T02:52:33.614ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e23bfc7-bc4c-465a-82ff-154b6c4446e4", "content-length": "134", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85452024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
85462024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
85472024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
85482024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
85492024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85502024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85512024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85522024-11-09T02:52:33.614ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85532024-11-09T02:52:33.615ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
85542024-11-09T02:52:33.615ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
85552024-11-09T02:52:33.615ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
85562024-11-09T02:52:33.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85572024-11-09T02:52:33.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85582024-11-09T02:52:33.617ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
85592024-11-09T02:52:33.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e4c336a-1da6-4dcc-aec9-4d0b6caaac91", "content-length": "2", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85602024-11-09T02:52:33.617ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
85612024-11-09T02:52:33.617ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc99ceb-628e-493f-8862-1be122a00e77", "content-length": "52", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85622024-11-09T02:52:33.617ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
85632024-11-09T02:52:33.617ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
85642024-11-09T02:52:33.724ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5fc61e0f-0e9d-4761-984a-a8c1211d19fa", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85652024-11-09T02:52:33.724ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
85662024-11-09T02:52:33.724ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
85672024-11-09T02:52:33.725ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "70199779-0ab9-4a6a-a935-192f242df206", "content-length": "682", "date": "Sat, 09 Nov 2024 02:52:33 GMT"} })
85682024-11-09T02:52:33.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85692024-11-09T02:52:33.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85702024-11-09T02:52:33.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85712024-11-09T02:52:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85722024-11-09T02:52:33.732ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85732024-11-09T02:52:33.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85742024-11-09T02:52:33.734ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85752024-11-09T02:52:33.735ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85762024-11-09T02:52:33.742ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 730.467355ms iteration = 13 status = {}
85772024-11-09T02:52:43.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
85782024-11-09T02:52:43.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85792024-11-09T02:52:43.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
85802024-11-09T02:52:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85812024-11-09T02:52:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85822024-11-09T02:52:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85832024-11-09T02:52:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85842024-11-09T02:52:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85852024-11-09T02:52:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85862024-11-09T02:52:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85872024-11-09T02:52:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85882024-11-09T02:52:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85892024-11-09T02:52:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85902024-11-09T02:52:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
85912024-11-09T02:52:43.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85922024-11-09T02:52:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85932024-11-09T02:52:43.036ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
85942024-11-09T02:52:43.036ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.415055ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
85952024-11-09T02:52:43.048ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85962024-11-09T02:52:43.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85972024-11-09T02:52:43.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.711217ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85982024-11-09T02:52:45.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1405 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 70382869-3451-4c7a-81fb-50a6bc351e18 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
85992024-11-09T02:52:50.143ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:57597
86002024-11-09T02:52:50.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7f2fc97e-7e03-40c4-9f88-d493e4869a90 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
86012024-11-09T02:52:50.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7f2fc97e-7e03-40c4-9f88-d493e4869a90 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
86022024-11-09T02:52:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2785 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7f2fc97e-7e03-40c4-9f88-d493e4869a90 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
86032024-11-09T02:52:50.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4d553a0e-6d7f-4d66-8f75-fa3ecb9b11a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
86042024-11-09T02:52:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4d553a0e-6d7f-4d66-8f75-fa3ecb9b11a5 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
86052024-11-09T02:52:50.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2681 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4d553a0e-6d7f-4d66-8f75-fa3ecb9b11a5 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
86062024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
86072024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
86082024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86092024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86102024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86112024-11-09T02:52:53.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86122024-11-09T02:52:53.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86132024-11-09T02:52:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86142024-11-09T02:52:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86152024-11-09T02:52:53.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.070714ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86162024-11-09T02:52:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86172024-11-09T02:52:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86182024-11-09T02:52:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86192024-11-09T02:52:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86202024-11-09T02:52:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86212024-11-09T02:52:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86222024-11-09T02:52:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
86232024-11-09T02:52:53.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86242024-11-09T02:52:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86252024-11-09T02:52:53.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
86262024-11-09T02:52:53.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.69087ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
86272024-11-09T02:53:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1144 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 6a15b474-fdbf-489c-b35c-e2aeb5d1c317 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
86282024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
86292024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86302024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
86312024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
86322024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86332024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86342024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
86352024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
86362024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
86372024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
86382024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86392024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86402024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
86412024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86422024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
86432024-11-09T02:53:03.011ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
86442024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
86452024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86462024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
86472024-11-09T02:53:03.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86482024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
86492024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
86502024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86512024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
86522024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
86532024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86542024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86552024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86562024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86572024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
86582024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86592024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86602024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86612024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86622024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86632024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86642024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86652024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86662024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86672024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
86682024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
86692024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
86702024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.371\u{b5}s iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
86712024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 16.461\u{b5}s iteration = 14 status = {"errors":[],"records_set_to_done":[]}
86722024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
86732024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.36\u{b5}s iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86742024-11-09T02:53:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 4.13\u{b5}s iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86752024-11-09T02:53:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86762024-11-09T02:53:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86772024-11-09T02:53:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.066264ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
86782024-11-09T02:53:03.016ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 354054355 } })
86792024-11-09T02:53:03.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86802024-11-09T02:53:03.016ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
86812024-11-09T02:53:03.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86822024-11-09T02:53:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86832024-11-09T02:53:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86842024-11-09T02:53:03.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86852024-11-09T02:53:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86862024-11-09T02:53:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86872024-11-09T02:53:03.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86882024-11-09T02:53:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86892024-11-09T02:53:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
86902024-11-09T02:53:03.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
86912024-11-09T02:53:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
86922024-11-09T02:53:03.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86932024-11-09T02:53:03.019ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 357613049 } })
86942024-11-09T02:53:03.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
86952024-11-09T02:53:03.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86962024-11-09T02:53:03.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86972024-11-09T02:53:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86982024-11-09T02:53:03.021ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86992024-11-09T02:53:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
87002024-11-09T02:53:03.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87012024-11-09T02:53:03.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87022024-11-09T02:53:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87032024-11-09T02:53:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
87042024-11-09T02:53:03.024ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87052024-11-09T02:53:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87062024-11-09T02:53:03.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87072024-11-09T02:53:03.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87082024-11-09T02:53:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87092024-11-09T02:53:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87102024-11-09T02:53:03.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1286, tv_nsec: 365192795 } })
87112024-11-09T02:53:03.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87122024-11-09T02:53:03.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
87132024-11-09T02:53:03.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87142024-11-09T02:53:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87152024-11-09T02:53:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
87162024-11-09T02:53:03.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
87172024-11-09T02:53:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
87182024-11-09T02:53:03.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87192024-11-09T02:53:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87202024-11-09T02:53:03.064ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
87212024-11-09T02:53:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
87222024-11-09T02:53:03.065ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.747771ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87232024-11-09T02:53:03.066ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87242024-11-09T02:53:03.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87252024-11-09T02:53:03.067ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87262024-11-09T02:53:03.067ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87272024-11-09T02:53:03.067ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
87282024-11-09T02:53:03.067ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87292024-11-09T02:53:03.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87302024-11-09T02:53:03.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87312024-11-09T02:53:03.069ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
87322024-11-09T02:53:03.069ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87332024-11-09T02:53:03.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87342024-11-09T02:53:03.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
87352024-11-09T02:53:03.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87362024-11-09T02:53:03.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87372024-11-09T02:53:03.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
87382024-11-09T02:53:03.072ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87392024-11-09T02:53:03.072ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dced98a6-d3e0-47d1-8511-7292061afef3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
87402024-11-09T02:53:03.072ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87412024-11-09T02:53:03.073ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
87422024-11-09T02:53:03.073ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87432024-11-09T02:53:03.073ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7085c9f5-075d-4bc9-8ef2-9824e09cdeba", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
87442024-11-09T02:53:03.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87452024-11-09T02:53:03.073ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
87462024-11-09T02:53:03.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.108714ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
87472024-11-09T02:53:03.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87482024-11-09T02:53:03.075ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
87492024-11-09T02:53:03.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
87502024-11-09T02:53:03.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 67.478744ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
87512024-11-09T02:53:03.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
87522024-11-09T02:53:03.090ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
87532024-11-09T02:53:03.091ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21f408c5-1146-4b90-9c7f-9f6b00436350", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
87542024-11-09T02:53:03.091ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
87552024-11-09T02:53:03.092ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
87562024-11-09T02:53:03.094ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87572024-11-09T02:53:03.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 82.845622ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
87582024-11-09T02:53:03.096ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87592024-11-09T02:53:03.096ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
87602024-11-09T02:53:03.096ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
87612024-11-09T02:53:03.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
87622024-11-09T02:53:03.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
87632024-11-09T02:53:03.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
87642024-11-09T02:53:03.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
87652024-11-09T02:53:03.098ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 86.810044ms iteration = 14 status = 0
87662024-11-09T02:53:03.127ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
87672024-11-09T02:53:03.127ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
87682024-11-09T02:53:03.127ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 115.360554ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
87692024-11-09T02:53:03.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87702024-11-09T02:53:03.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87712024-11-09T02:53:03.135ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.069414ms iteration = 16 status = {"physical_disks_added":0}
87722024-11-09T02:53:03.159ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
87732024-11-09T02:53:03.160ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "07c14974-f69d-481a-8535-96b59a498a92", "content-length": "1", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
87742024-11-09T02:53:03.162ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
87752024-11-09T02:53:03.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
87762024-11-09T02:53:03.167ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 155.956873ms iteration = 14 status = null
87772024-11-09T02:53:03.169ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 157.975495ms iteration = 14 status = {}
87782024-11-09T02:53:03.198ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
87792024-11-09T02:53:03.199ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87802024-11-09T02:53:03.199ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2204427-f88d-4dcc-9efd-396c918ef63f", "content-length": "372", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
87812024-11-09T02:53:03.199ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87822024-11-09T02:53:03.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87832024-11-09T02:53:03.269ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87842024-11-09T02:53:03.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87852024-11-09T02:53:03.270ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
87862024-11-09T02:53:03.270ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
87872024-11-09T02:53:03.270ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "d89a92ca-cae6-4db2-b3d7-e7efe55c895e", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
87882024-11-09T02:53:03.271ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87892024-11-09T02:53:03.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87902024-11-09T02:53:03.276ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
87912024-11-09T02:53:03.276ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87922024-11-09T02:53:03.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87932024-11-09T02:53:03.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87942024-11-09T02:53:03.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87952024-11-09T02:53:03.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87962024-11-09T02:53:03.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87972024-11-09T02:53:03.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87982024-11-09T02:53:03.282ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87992024-11-09T02:53:03.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88002024-11-09T02:53:03.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88012024-11-09T02:53:03.283ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88022024-11-09T02:53:03.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88032024-11-09T02:53:03.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88042024-11-09T02:53:03.286ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
88052024-11-09T02:53:03.286ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88062024-11-09T02:53:03.286ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88072024-11-09T02:53:03.288ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
88082024-11-09T02:53:03.288ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
88092024-11-09T02:53:03.288ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8d0a5d45-18f9-4992-9a5b-38d1c71ad539", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
88102024-11-09T02:53:03.288ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
88112024-11-09T02:53:03.289ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b762f60-d9dd-49b1-84e3-7902dc964e2a", "content-length": "134", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
88122024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
88132024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
88142024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
88152024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
88162024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88172024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88182024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88192024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88202024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
88212024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
88222024-11-09T02:53:03.289ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
88232024-11-09T02:53:03.289ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88242024-11-09T02:53:03.290ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88252024-11-09T02:53:03.290ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 279.119948ms iteration = 15 status = {}
88262024-11-09T02:53:03.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
88272024-11-09T02:53:03.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6328e7d6-45eb-4661-b6fa-9b24393094fb", "content-length": "2", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
88282024-11-09T02:53:03.292ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
88292024-11-09T02:53:03.292ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "04194651-6ef4-4c1c-9331-0e047819b4ca", "content-length": "52", "date": "Sat, 09 Nov 2024 02:53:02 GMT"} })
88302024-11-09T02:53:03.292ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
88312024-11-09T02:53:03.292ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
88322024-11-09T02:53:03.331ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
88332024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "7c7be449-5ce6-4e88-9860-a96da99a942a", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
88342024-11-09T02:53:03.403ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
88352024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
88362024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2613e00-9c0c-4103-85f0-866fa796b97c", "content-length": "682", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
88372024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88382024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88392024-11-09T02:53:03.403ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7ab77dee-6744-4916-9948-0e4d9bea0d8c", "content-length": "691", "date": "Sat, 09 Nov 2024 02:53:03 GMT"} })
88402024-11-09T02:53:03.403ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
88412024-11-09T02:53:03.403ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
88422024-11-09T02:53:03.403ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
88432024-11-09T02:53:03.406ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 394.787408ms iteration = 14 status = {}
88442024-11-09T02:53:03.407ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88452024-11-09T02:53:03.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88462024-11-09T02:53:03.410ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88472024-11-09T02:53:03.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88482024-11-09T02:53:03.412ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88492024-11-09T02:53:03.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88502024-11-09T02:53:03.421ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 409.729347ms iteration = 14 status = {}
88512024-11-09T02:53:13.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
88522024-11-09T02:53:13.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88532024-11-09T02:53:13.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
88542024-11-09T02:53:13.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88552024-11-09T02:53:13.011ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88562024-11-09T02:53:13.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88572024-11-09T02:53:13.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88582024-11-09T02:53:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88592024-11-09T02:53:13.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88602024-11-09T02:53:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88612024-11-09T02:53:13.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88622024-11-09T02:53:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88632024-11-09T02:53:13.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88642024-11-09T02:53:13.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88652024-11-09T02:53:13.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88662024-11-09T02:53:13.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
88672024-11-09T02:53:13.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88682024-11-09T02:53:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88692024-11-09T02:53:13.033ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
88702024-11-09T02:53:13.033ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.932704ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
88712024-11-09T02:53:13.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.221835ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88722024-11-09T02:53:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1168 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = c04c8e05-508e-4172-a5ea-844d4a4dc3bb response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
88732024-11-09T02:53:20.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 12b75fff-56ac-409c-968a-b4bf868904b9 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
88742024-11-09T02:53:20.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 12b75fff-56ac-409c-968a-b4bf868904b9 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
88752024-11-09T02:53:20.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 12b75fff-56ac-409c-968a-b4bf868904b9 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
88762024-11-09T02:53:20.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 6e8ac74b-e6bf-4ec6-bcad-68c81ae547ca roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
88772024-11-09T02:53:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 6e8ac74b-e6bf-4ec6-bcad-68c81ae547ca resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
88782024-11-09T02:53:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2402 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 6e8ac74b-e6bf-4ec6-bcad-68c81ae547ca response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
88792024-11-09T02:53:23.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
88802024-11-09T02:53:23.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
88812024-11-09T02:53:23.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88822024-11-09T02:53:23.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88832024-11-09T02:53:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88842024-11-09T02:53:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88852024-11-09T02:53:23.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88862024-11-09T02:53:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88872024-11-09T02:53:23.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88882024-11-09T02:53:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88892024-11-09T02:53:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88902024-11-09T02:53:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88912024-11-09T02:53:23.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88922024-11-09T02:53:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
88932024-11-09T02:53:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88942024-11-09T02:53:23.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88952024-11-09T02:53:23.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
88962024-11-09T02:53:23.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.877161ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
88972024-11-09T02:53:23.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88982024-11-09T02:53:23.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88992024-11-09T02:53:23.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.825887ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89002024-11-09T02:53:30.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1048 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 0a89bf35-0214-4ff6-bc43-2f6982bcaeff response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
89012024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
89022024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
89032024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
89042024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89052024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
89062024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
89072024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89082024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
89092024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
89102024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
89112024-11-09T02:53:33.011ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
89122024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
89132024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
89142024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.88\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
89152024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
89162024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89172024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
89182024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89192024-11-09T02:53:33.011ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
89202024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89212024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
89222024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
89232024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89242024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
89252024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
89262024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
89272024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
89282024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89292024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89302024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
89312024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
89322024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89332024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
89342024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89352024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
89362024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
89372024-11-09T02:53:33.011ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
89382024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
89392024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89402024-11-09T02:53:33.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
89412024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89422024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
89432024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89442024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
89452024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
89462024-11-09T02:53:33.012ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:43:33.011828224 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
89472024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89482024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
89492024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
89502024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
89512024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89522024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
89532024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
89542024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
89552024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 18.3\u{b5}s iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
89562024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
89572024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
89582024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.46\u{b5}s iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
89592024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 7.669\u{b5}s iteration = 15 status = {"errors":[],"records_set_to_done":[]}
89602024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
89612024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
89622024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
89632024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.01\u{b5}s iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
89642024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
89652024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89662024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
89672024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89682024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89692024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89702024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89712024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89722024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89732024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89742024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89752024-11-09T02:53:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 350249606 } })
89762024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89772024-11-09T02:53:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 350284377 } })
89782024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
89792024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89802024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
89812024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89822024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89832024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89842024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89852024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89862024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.111203ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89872024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
89882024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.357658ms iteration = 9 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
89892024-11-09T02:53:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89902024-11-09T02:53:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89912024-11-09T02:53:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.671695ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89922024-11-09T02:53:33.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89932024-11-09T02:53:33.015ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 353400332 } })
89942024-11-09T02:53:33.015ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
89952024-11-09T02:53:33.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89962024-11-09T02:53:33.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89972024-11-09T02:53:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89982024-11-09T02:53:33.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89992024-11-09T02:53:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
90002024-11-09T02:53:33.019ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90012024-11-09T02:53:33.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90022024-11-09T02:53:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90032024-11-09T02:53:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
90042024-11-09T02:53:33.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90052024-11-09T02:53:33.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90062024-11-09T02:53:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90072024-11-09T02:53:33.021ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
90082024-11-09T02:53:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
90092024-11-09T02:53:33.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90102024-11-09T02:53:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
90112024-11-09T02:53:33.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
90122024-11-09T02:53:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
90132024-11-09T02:53:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90142024-11-09T02:53:33.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90152024-11-09T02:53:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90162024-11-09T02:53:33.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90172024-11-09T02:53:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90182024-11-09T02:53:33.027ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90192024-11-09T02:53:33.027ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:43:33.011828224 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
90202024-11-09T02:53:33.027ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 15.48367ms iteration = 8 status = {"expiration":"2024-11-09T02:43:33.011828224Z","pruned":[]}
90212024-11-09T02:53:33.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 365483241 } })
90222024-11-09T02:53:33.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
90232024-11-09T02:53:33.028ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.45343ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
90242024-11-09T02:53:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
90252024-11-09T02:53:33.029ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
90262024-11-09T02:53:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
90272024-11-09T02:53:33.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1316, tv_nsec: 369945884 } })
90282024-11-09T02:53:33.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90292024-11-09T02:53:33.032ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
90302024-11-09T02:53:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90312024-11-09T02:53:33.036ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90322024-11-09T02:53:33.037ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90332024-11-09T02:53:33.037ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90342024-11-09T02:53:33.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90352024-11-09T02:53:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90362024-11-09T02:53:33.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90372024-11-09T02:53:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90382024-11-09T02:53:33.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90392024-11-09T02:53:33.048ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90402024-11-09T02:53:33.048ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90412024-11-09T02:53:33.048ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90422024-11-09T02:53:33.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90432024-11-09T02:53:33.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90442024-11-09T02:53:33.051ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90452024-11-09T02:53:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90462024-11-09T02:53:33.054ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90472024-11-09T02:53:33.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90482024-11-09T02:53:33.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90492024-11-09T02:53:33.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90502024-11-09T02:53:33.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90512024-11-09T02:53:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90522024-11-09T02:53:33.064ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90532024-11-09T02:53:33.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90542024-11-09T02:53:33.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90552024-11-09T02:53:33.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90562024-11-09T02:53:33.068ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
90572024-11-09T02:53:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90582024-11-09T02:53:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
90592024-11-09T02:53:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
90602024-11-09T02:53:33.069ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90612024-11-09T02:53:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90622024-11-09T02:53:33.070ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90632024-11-09T02:53:33.070ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
90642024-11-09T02:53:33.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90652024-11-09T02:53:33.070ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90662024-11-09T02:53:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90672024-11-09T02:53:33.070ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90682024-11-09T02:53:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90692024-11-09T02:53:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.886458ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90702024-11-09T02:53:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.042661ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
90712024-11-09T02:53:33.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90722024-11-09T02:53:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
90732024-11-09T02:53:33.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90742024-11-09T02:53:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90752024-11-09T02:53:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
90762024-11-09T02:53:33.075ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90772024-11-09T02:53:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90782024-11-09T02:53:33.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90792024-11-09T02:53:33.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90802024-11-09T02:53:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90812024-11-09T02:53:33.077ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
90822024-11-09T02:53:33.077ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
90832024-11-09T02:53:33.077ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 65.461823ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
90842024-11-09T02:53:33.077ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90852024-11-09T02:53:33.077ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.317961ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90862024-11-09T02:53:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
90872024-11-09T02:53:33.078ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
90882024-11-09T02:53:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
90892024-11-09T02:53:33.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90902024-11-09T02:53:33.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90912024-11-09T02:53:33.079ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 68.059957ms iteration = 15 status = 0
90922024-11-09T02:53:33.081ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90932024-11-09T02:53:33.081ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90942024-11-09T02:53:33.081ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 69.429325ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90952024-11-09T02:53:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90962024-11-09T02:53:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
90972024-11-09T02:53:33.084ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90982024-11-09T02:53:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90992024-11-09T02:53:33.092ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
91002024-11-09T02:53:33.092ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
91012024-11-09T02:53:33.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91022024-11-09T02:53:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91032024-11-09T02:53:33.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
91042024-11-09T02:53:33.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.22452ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
91052024-11-09T02:53:33.099ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
91062024-11-09T02:53:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
91072024-11-09T02:53:33.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91082024-11-09T02:53:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91092024-11-09T02:53:33.102ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91102024-11-09T02:53:33.103ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91112024-11-09T02:53:33.103ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
91122024-11-09T02:53:33.103ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
91132024-11-09T02:53:33.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
91142024-11-09T02:53:33.104ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
91152024-11-09T02:53:33.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
91162024-11-09T02:53:33.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
91172024-11-09T02:53:33.113ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
91182024-11-09T02:53:33.113ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 102.11415ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
91192024-11-09T02:53:33.121ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
91202024-11-09T02:53:33.121ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
91212024-11-09T02:53:33.121ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
91222024-11-09T02:53:33.121ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91232024-11-09T02:53:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91242024-11-09T02:53:33.128ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91252024-11-09T02:53:33.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
91262024-11-09T02:53:33.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91272024-11-09T02:53:33.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91282024-11-09T02:53:33.144ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
91292024-11-09T02:53:33.144ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
91302024-11-09T02:53:33.144ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.005329ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
91312024-11-09T02:53:33.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91322024-11-09T02:53:33.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91332024-11-09T02:53:33.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91342024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91352024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91362024-11-09T02:53:33.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91372024-11-09T02:53:33.221ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
91382024-11-09T02:53:33.221ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91392024-11-09T02:53:33.221ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 209.507599ms iteration = 17 status = {"physical_disks_added":0}
91402024-11-09T02:53:33.221ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b662080-e78c-452e-8010-5ec76aed7575", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:32 GMT"} })
91412024-11-09T02:53:33.221ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91422024-11-09T02:53:33.224ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91432024-11-09T02:53:33.241ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91442024-11-09T02:53:33.241ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 230.087825ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91452024-11-09T02:53:33.266ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
91462024-11-09T02:53:33.284ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91472024-11-09T02:53:33.284ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91482024-11-09T02:53:33.284ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6aa41539-0b80-4e75-9077-aa5c88f134a1", "content-length": "372", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
91492024-11-09T02:53:33.284ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91502024-11-09T02:53:33.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91512024-11-09T02:53:33.287ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
91522024-11-09T02:53:33.287ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
91532024-11-09T02:53:33.287ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
91542024-11-09T02:53:33.288ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 276.246129ms iteration = 9 status = {"generation":2}
91552024-11-09T02:53:33.313ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91562024-11-09T02:53:33.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91572024-11-09T02:53:33.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91582024-11-09T02:53:33.321ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91592024-11-09T02:53:33.321ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91602024-11-09T02:53:33.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91612024-11-09T02:53:33.332ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
91622024-11-09T02:53:33.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
91632024-11-09T02:53:33.332ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91642024-11-09T02:53:33.333ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dcc250f5-4aca-4c75-8541-79b61695e008", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:32 GMT"} })
91652024-11-09T02:53:33.333ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91662024-11-09T02:53:33.335ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91672024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
91682024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
91692024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91702024-11-09T02:53:33.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91712024-11-09T02:53:33.345ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91722024-11-09T02:53:33.349ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
91732024-11-09T02:53:33.349ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
91742024-11-09T02:53:33.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
91752024-11-09T02:53:33.352ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
91762024-11-09T02:53:33.352ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
91772024-11-09T02:53:33.352ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
91782024-11-09T02:53:33.352ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 341.15441ms iteration = 9 status = {"generation":1}
91792024-11-09T02:53:33.355ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
91802024-11-09T02:53:33.357ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
91812024-11-09T02:53:33.357ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91822024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
91832024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
91842024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6c762d7b-a087-4d55-bc0e-6bf7ec49b551", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
91852024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91862024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
91872024-11-09T02:53:33.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91882024-11-09T02:53:33.361ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91892024-11-09T02:53:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91902024-11-09T02:53:33.363ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
91912024-11-09T02:53:33.363ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91922024-11-09T02:53:33.363ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "9b510f9f-29ae-48da-8853-b4a32def3543", "content-length": "26", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
91932024-11-09T02:53:33.363ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91942024-11-09T02:53:33.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91952024-11-09T02:53:33.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91962024-11-09T02:53:33.366ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
91972024-11-09T02:53:33.369ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91982024-11-09T02:53:33.369ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91992024-11-09T02:53:33.369ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ae38288e-63d0-4634-897e-5e255aa96c88", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92002024-11-09T02:53:33.372ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 360.401918ms iteration = 16 status = {}
92012024-11-09T02:53:33.393ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
92022024-11-09T02:53:33.394ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b39efea8-bde5-4a85-8255-cd908fd89d9d", "content-length": "1", "date": "Sat, 09 Nov 2024 02:53:32 GMT"} })
92032024-11-09T02:53:33.396ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92042024-11-09T02:53:33.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92052024-11-09T02:53:33.398ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 386.588949ms iteration = 15 status = null
92062024-11-09T02:53:33.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
92072024-11-09T02:53:33.453ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "6d773201-d4f4-42f5-99f9-a4482a478b08", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92082024-11-09T02:53:33.453ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92092024-11-09T02:53:33.455ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "c51abfdc-77a2-4882-9975-2d56d1e87d71", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92102024-11-09T02:53:33.455ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92112024-11-09T02:53:33.456ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
92122024-11-09T02:53:33.456ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 445.070007ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
92132024-11-09T02:53:33.466ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 455.237468ms iteration = 15 status = {}
92142024-11-09T02:53:33.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
92152024-11-09T02:53:33.646ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
92162024-11-09T02:53:33.647ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "65d8d745-88f3-4ead-8aab-ff4212cc2b74", "content-length": "691", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92172024-11-09T02:53:33.647ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
92182024-11-09T02:53:33.647ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
92192024-11-09T02:53:33.647ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
92202024-11-09T02:53:33.648ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 636.691308ms iteration = 15 status = {}
92212024-11-09T02:53:33.651ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
92222024-11-09T02:53:33.651ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "885444b3-225b-4dd0-9d47-11e6760e8b98", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92232024-11-09T02:53:33.651ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92242024-11-09T02:53:33.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92252024-11-09T02:53:33.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92262024-11-09T02:53:33.654ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "da720b0b-dae9-4c24-af8c-dfa59413045e", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92272024-11-09T02:53:33.654ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92282024-11-09T02:53:33.655ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
92292024-11-09T02:53:33.655ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92302024-11-09T02:53:33.655ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92312024-11-09T02:53:33.656ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1513f370-215d-44da-9eed-5fc94e52f027", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92322024-11-09T02:53:33.656ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92332024-11-09T02:53:33.658ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
92342024-11-09T02:53:33.658ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 646.842628ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
92352024-11-09T02:53:33.666ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
92362024-11-09T02:53:33.666ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "06c6216d-d818-4d4c-84c2-ec9faa5d2049", "content-length": "134", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92372024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
92382024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
92392024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
92402024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
92412024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92422024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92432024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92442024-11-09T02:53:33.666ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92452024-11-09T02:53:33.667ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
92462024-11-09T02:53:33.667ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
92472024-11-09T02:53:33.667ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
92482024-11-09T02:53:33.667ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92492024-11-09T02:53:33.667ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92502024-11-09T02:53:33.669ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
92512024-11-09T02:53:33.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0b8ce896-5fd4-4545-ba22-24355c29c6b5", "content-length": "2", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92522024-11-09T02:53:33.669ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
92532024-11-09T02:53:33.669ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3561b38d-628d-47c3-8f73-ea7e7ad7ad73", "content-length": "52", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92542024-11-09T02:53:33.669ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
92552024-11-09T02:53:33.669ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
92562024-11-09T02:53:33.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "815dea9c-6671-443c-9399-fed7a9ac4b61", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92572024-11-09T02:53:33.776ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
92582024-11-09T02:53:33.776ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
92592024-11-09T02:53:33.776ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2d3f39bd-25ef-4431-b115-13cefe109ea6", "content-length": "682", "date": "Sat, 09 Nov 2024 02:53:33 GMT"} })
92602024-11-09T02:53:33.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92612024-11-09T02:53:33.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92622024-11-09T02:53:33.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92632024-11-09T02:53:33.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92642024-11-09T02:53:33.783ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92652024-11-09T02:53:33.783ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92662024-11-09T02:53:33.785ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92672024-11-09T02:53:33.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92682024-11-09T02:53:33.792ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 781.051251ms iteration = 15 status = {}
92692024-11-09T02:53:43.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
92702024-11-09T02:53:43.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
92712024-11-09T02:53:43.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92722024-11-09T02:53:43.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92732024-11-09T02:53:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92742024-11-09T02:53:43.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92752024-11-09T02:53:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92762024-11-09T02:53:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92772024-11-09T02:53:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92782024-11-09T02:53:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92792024-11-09T02:53:43.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92802024-11-09T02:53:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92812024-11-09T02:53:43.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92822024-11-09T02:53:43.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
92832024-11-09T02:53:43.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92842024-11-09T02:53:43.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92852024-11-09T02:53:43.040ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
92862024-11-09T02:53:43.040ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 28.948318ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
92872024-11-09T02:53:43.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92882024-11-09T02:53:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92892024-11-09T02:53:43.074ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.004532ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92902024-11-09T02:53:45.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1525 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 231645ef-599f-4652-b974-4dfa7b6f2ee7 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
92912024-11-09T02:53:50.142ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 14371b83-043a-4adc-b6a6-37575e12282b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
92922024-11-09T02:53:50.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 14371b83-043a-4adc-b6a6-37575e12282b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
92932024-11-09T02:53:50.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3016 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 14371b83-043a-4adc-b6a6-37575e12282b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
92942024-11-09T02:53:50.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = dafd92b8-bde8-42e4-b693-0852dd3f2e72 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
92952024-11-09T02:53:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = dafd92b8-bde8-42e4-b693-0852dd3f2e72 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
92962024-11-09T02:53:50.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2018 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = dafd92b8-bde8-42e4-b693-0852dd3f2e72 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
92972024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
92982024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
92992024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93002024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93012024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93022024-11-09T02:53:53.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93032024-11-09T02:53:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93042024-11-09T02:53:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93052024-11-09T02:53:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93062024-11-09T02:53:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93072024-11-09T02:53:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93082024-11-09T02:53:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93092024-11-09T02:53:53.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93102024-11-09T02:53:53.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93112024-11-09T02:53:53.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93122024-11-09T02:53:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
93132024-11-09T02:53:53.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93142024-11-09T02:53:53.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93152024-11-09T02:53:53.061ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
93162024-11-09T02:53:53.061ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.915751ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
93172024-11-09T02:53:53.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.579814ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93182024-11-09T02:54:00.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1417 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 690dc67d-4aac-4372-80ca-0aa320e1b7eb response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
93192024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
93202024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
93212024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93222024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
93232024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93242024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93252024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
93262024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93272024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
93282024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93292024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
93302024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
93312024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
93322024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93332024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93342024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
93352024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
93362024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93372024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
93382024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
93392024-11-09T02:54:03.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
93402024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
93412024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93422024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
93432024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
93442024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
93452024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93462024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93472024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93482024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
93492024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
93502024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
93512024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.54\u{b5}s iteration = 16 status = {"errors":[],"records_set_to_done":[]}
93522024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.41\u{b5}s iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
93532024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 6.45\u{b5}s iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93542024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
93552024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93562024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.88\u{b5}s iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
93572024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93582024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93592024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93602024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
93612024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93622024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
93632024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93642024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93652024-11-09T02:54:03.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93662024-11-09T02:54:03.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93672024-11-09T02:54:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93682024-11-09T02:54:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.839669ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93692024-11-09T02:54:03.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93702024-11-09T02:54:03.016ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 354379412 } })
93712024-11-09T02:54:03.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
93722024-11-09T02:54:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93732024-11-09T02:54:03.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93742024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93752024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93762024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93772024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93782024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93792024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93802024-11-09T02:54:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93812024-11-09T02:54:03.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 358727992 } })
93822024-11-09T02:54:03.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
93832024-11-09T02:54:03.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93842024-11-09T02:54:03.022ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93852024-11-09T02:54:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93862024-11-09T02:54:03.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93872024-11-09T02:54:03.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93882024-11-09T02:54:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93892024-11-09T02:54:03.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1346, tv_nsec: 363430889 } })
93902024-11-09T02:54:03.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
93912024-11-09T02:54:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93922024-11-09T02:54:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93932024-11-09T02:54:03.055ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93942024-11-09T02:54:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93952024-11-09T02:54:03.057ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93962024-11-09T02:54:03.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93972024-11-09T02:54:03.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93982024-11-09T02:54:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93992024-11-09T02:54:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
94002024-11-09T02:54:03.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94012024-11-09T02:54:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
94022024-11-09T02:54:03.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
94032024-11-09T02:54:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
94042024-11-09T02:54:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94052024-11-09T02:54:03.061ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94062024-11-09T02:54:03.062ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94072024-11-09T02:54:03.062ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
94082024-11-09T02:54:03.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94092024-11-09T02:54:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94102024-11-09T02:54:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94112024-11-09T02:54:03.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94122024-11-09T02:54:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94132024-11-09T02:54:03.064ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 52.571856ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94142024-11-09T02:54:03.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94152024-11-09T02:54:03.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94162024-11-09T02:54:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94172024-11-09T02:54:03.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
94182024-11-09T02:54:03.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94192024-11-09T02:54:03.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94202024-11-09T02:54:03.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94212024-11-09T02:54:03.070ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
94222024-11-09T02:54:03.070ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94232024-11-09T02:54:03.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94242024-11-09T02:54:03.070ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 58.390397ms iteration = 16 status = 0
94252024-11-09T02:54:03.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94262024-11-09T02:54:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
94272024-11-09T02:54:03.074ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94282024-11-09T02:54:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94292024-11-09T02:54:03.085ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 73.519709ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
94302024-11-09T02:54:03.085ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
94312024-11-09T02:54:03.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.773544ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
94322024-11-09T02:54:03.090ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94332024-11-09T02:54:03.090ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94342024-11-09T02:54:03.090ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "182477d5-26ad-4294-b8c2-5dd1ba5c6904", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
94352024-11-09T02:54:03.090ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94362024-11-09T02:54:03.092ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94372024-11-09T02:54:03.095ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94382024-11-09T02:54:03.095ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
94392024-11-09T02:54:03.095ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
94402024-11-09T02:54:03.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
94412024-11-09T02:54:03.096ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94422024-11-09T02:54:03.099ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
94432024-11-09T02:54:03.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
94442024-11-09T02:54:03.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
94452024-11-09T02:54:03.100ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
94462024-11-09T02:54:03.100ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.145952ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
94472024-11-09T02:54:03.109ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
94482024-11-09T02:54:03.109ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94492024-11-09T02:54:03.110ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4da895af-7ee7-4d6a-9e01-a1c2c23a5211", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
94502024-11-09T02:54:03.110ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94512024-11-09T02:54:03.112ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
94522024-11-09T02:54:03.112ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
94532024-11-09T02:54:03.112ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
94542024-11-09T02:54:03.112ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "563fb3fd-8e9a-4ccc-802b-00433c70e270", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:02 GMT"} })
94552024-11-09T02:54:03.112ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
94562024-11-09T02:54:03.115ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
94572024-11-09T02:54:03.126ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94582024-11-09T02:54:03.126ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94592024-11-09T02:54:03.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.647829ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94602024-11-09T02:54:03.139ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94612024-11-09T02:54:03.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94622024-11-09T02:54:03.210ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94632024-11-09T02:54:03.210ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dd404db5-097c-4e32-8881-f35160595ab2", "content-length": "1", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
94642024-11-09T02:54:03.213ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94652024-11-09T02:54:03.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94662024-11-09T02:54:03.216ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 203.855473ms iteration = 16 status = null
94672024-11-09T02:54:03.222ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 210.01666ms iteration = 16 status = {}
94682024-11-09T02:54:03.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 214.433482ms iteration = 18 status = {"physical_disks_added":0}
94692024-11-09T02:54:03.237ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
94702024-11-09T02:54:03.237ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94712024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f55fd6b-f721-46fe-b170-b67746872661", "content-length": "372", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
94722024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94732024-11-09T02:54:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94742024-11-09T02:54:03.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94752024-11-09T02:54:03.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94762024-11-09T02:54:03.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94772024-11-09T02:54:03.278ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94782024-11-09T02:54:03.278ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94792024-11-09T02:54:03.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94802024-11-09T02:54:03.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94812024-11-09T02:54:03.285ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94822024-11-09T02:54:03.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94832024-11-09T02:54:03.285ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94842024-11-09T02:54:03.297ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
94852024-11-09T02:54:03.297ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94862024-11-09T02:54:03.297ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5bee3d59-516b-49ee-a92a-1da53a693550", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
94872024-11-09T02:54:03.297ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94882024-11-09T02:54:03.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94892024-11-09T02:54:03.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94902024-11-09T02:54:03.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94912024-11-09T02:54:03.304ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94922024-11-09T02:54:03.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94932024-11-09T02:54:03.308ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94942024-11-09T02:54:03.308ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94952024-11-09T02:54:03.308ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "82eb0dc7-7284-43f8-a9ad-0a05a045499a", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
94962024-11-09T02:54:03.310ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.437548ms iteration = 17 status = {}
94972024-11-09T02:54:03.345ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94982024-11-09T02:54:03.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94992024-11-09T02:54:03.348ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
95002024-11-09T02:54:03.349ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a3330c7-2693-43a6-afb5-2db9fe678dfe", "content-length": "691", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95012024-11-09T02:54:03.349ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
95022024-11-09T02:54:03.349ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
95032024-11-09T02:54:03.349ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
95042024-11-09T02:54:03.350ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 338.70536ms iteration = 16 status = {}
95052024-11-09T02:54:03.351ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
95062024-11-09T02:54:03.351ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95072024-11-09T02:54:03.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95082024-11-09T02:54:03.362ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
95092024-11-09T02:54:03.362ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "92b12b39-37b1-4b7c-8e2a-d548f3799031", "content-length": "134", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95102024-11-09T02:54:03.362ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
95112024-11-09T02:54:03.362ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
95122024-11-09T02:54:03.362ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
95132024-11-09T02:54:03.362ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
95142024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95152024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95162024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95172024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95182024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
95192024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
95202024-11-09T02:54:03.363ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
95212024-11-09T02:54:03.363ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95222024-11-09T02:54:03.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95232024-11-09T02:54:03.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
95242024-11-09T02:54:03.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa8e8f63-0f89-4a50-a87c-e23b754f30f0", "content-length": "2", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95252024-11-09T02:54:03.366ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
95262024-11-09T02:54:03.366ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e975d5cd-957a-4d03-afd2-3ae5039516c3", "content-length": "52", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95272024-11-09T02:54:03.366ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
95282024-11-09T02:54:03.366ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
95292024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "f03fb860-0a55-48f6-b855-a0a593ab615f", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95302024-11-09T02:54:03.478ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
95312024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
95322024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "97081ddb-c1a5-47ee-bdd0-96d975b7fd6e", "content-length": "682", "date": "Sat, 09 Nov 2024 02:54:03 GMT"} })
95332024-11-09T02:54:03.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95342024-11-09T02:54:03.479ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95352024-11-09T02:54:03.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95362024-11-09T02:54:03.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95372024-11-09T02:54:03.486ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95382024-11-09T02:54:03.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95392024-11-09T02:54:03.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95402024-11-09T02:54:03.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
95412024-11-09T02:54:03.497ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 485.011363ms iteration = 16 status = {}
95422024-11-09T02:54:05.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 26bb7a51-45ba-4dae-b13e-17a82f4f8c83 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95432024-11-09T02:54:05.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 26bb7a51-45ba-4dae-b13e-17a82f4f8c83 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95442024-11-09T02:54:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2966 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 26bb7a51-45ba-4dae-b13e-17a82f4f8c83 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95452024-11-09T02:54:05.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3c666a7d-9b76-457f-96a9-91a8a2b8ca7e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95462024-11-09T02:54:05.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3c666a7d-9b76-457f-96a9-91a8a2b8ca7e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95472024-11-09T02:54:05.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1983 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3c666a7d-9b76-457f-96a9-91a8a2b8ca7e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95482024-11-09T02:54:13.011ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
95492024-11-09T02:54:13.011ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95502024-11-09T02:54:13.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
95512024-11-09T02:54:13.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95522024-11-09T02:54:13.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95532024-11-09T02:54:13.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95542024-11-09T02:54:13.039ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95552024-11-09T02:54:13.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95562024-11-09T02:54:13.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95572024-11-09T02:54:13.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95582024-11-09T02:54:13.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95592024-11-09T02:54:13.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95602024-11-09T02:54:13.045ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95612024-11-09T02:54:13.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95622024-11-09T02:54:13.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95632024-11-09T02:54:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
95642024-11-09T02:54:13.050ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95652024-11-09T02:54:13.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95662024-11-09T02:54:13.062ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
95672024-11-09T02:54:13.062ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.448802ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
95682024-11-09T02:54:13.066ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 54.839793ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95692024-11-09T02:54:15.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1070 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = c7766e72-63fc-406e-a8a0-c93f742e123b response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
95702024-11-09T02:54:16.812ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63920
95712024-11-09T02:54:16.812ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63920 req_id = 39f0b041-c219-49ef-9079-acb493fcdf72 roles = RoleSet { roles: {} } uri = /metrics/producers
95722024-11-09T02:54:16.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63920 req_id = 39f0b041-c219-49ef-9079-acb493fcdf72 resource = Database result = Ok(()) uri = /metrics/producers
95732024-11-09T02:54:16.847ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
95742024-11-09T02:54:16.847ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 34666 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63920 req_id = 39f0b041-c219-49ef-9079-acb493fcdf72 response_code = 201 uri = /metrics/producers
95752024-11-09T02:54:18.514ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50701
95762024-11-09T02:54:18.514ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50701 req_id = 295c08aa-77dc-437e-842c-8e3711a773c5 roles = RoleSet { roles: {} } uri = /metrics/producers
95772024-11-09T02:54:18.514ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50701 req_id = 295c08aa-77dc-437e-842c-8e3711a773c5 resource = Database result = Ok(()) uri = /metrics/producers
95782024-11-09T02:54:18.550ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
95792024-11-09T02:54:18.550ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35567 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50701 req_id = 295c08aa-77dc-437e-842c-8e3711a773c5 response_code = 201 uri = /metrics/producers
95802024-11-09T02:54:20.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a1626277-6c8b-4e12-83f5-180fb063b93f roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95812024-11-09T02:54:20.143ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a1626277-6c8b-4e12-83f5-180fb063b93f resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95822024-11-09T02:54:20.145ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2673 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a1626277-6c8b-4e12-83f5-180fb063b93f response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
95832024-11-09T02:54:20.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4347b496-c296-410f-b722-dc01836ca68e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95842024-11-09T02:54:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4347b496-c296-410f-b722-dc01836ca68e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95852024-11-09T02:54:20.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1848 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 4347b496-c296-410f-b722-dc01836ca68e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
95862024-11-09T02:54:22.453ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:39513
95872024-11-09T02:54:22.453ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39513 req_id = 1731ac59-7041-4b03-8231-7a9015ab0225 roles = RoleSet { roles: {} } uri = /metrics/producers
95882024-11-09T02:54:22.454ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39513 req_id = 1731ac59-7041-4b03-8231-7a9015ab0225 resource = Database result = Ok(()) uri = /metrics/producers
95892024-11-09T02:54:22.489ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
95902024-11-09T02:54:22.489ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35373 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39513 req_id = 1731ac59-7041-4b03-8231-7a9015ab0225 response_code = 201 uri = /metrics/producers
95912024-11-09T02:54:22.746ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61818
95922024-11-09T02:54:22.746ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61818 req_id = e028dea8-095f-44e1-b5b1-7fbb551a86f8 roles = RoleSet { roles: {} } uri = /metrics/producers
95932024-11-09T02:54:22.746ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61818 req_id = e028dea8-095f-44e1-b5b1-7fbb551a86f8 resource = Database result = Ok(()) uri = /metrics/producers
95942024-11-09T02:54:22.756ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
95952024-11-09T02:54:22.756ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 9551 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61818 req_id = e028dea8-095f-44e1-b5b1-7fbb551a86f8 response_code = 201 uri = /metrics/producers
95962024-11-09T02:54:23.011ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
95972024-11-09T02:54:23.011ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95982024-11-09T02:54:23.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
95992024-11-09T02:54:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96002024-11-09T02:54:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96012024-11-09T02:54:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96022024-11-09T02:54:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96032024-11-09T02:54:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96042024-11-09T02:54:23.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96052024-11-09T02:54:23.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.149034ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
96062024-11-09T02:54:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96072024-11-09T02:54:23.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96082024-11-09T02:54:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96092024-11-09T02:54:23.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96102024-11-09T02:54:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96112024-11-09T02:54:23.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96122024-11-09T02:54:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
96132024-11-09T02:54:23.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96142024-11-09T02:54:23.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96152024-11-09T02:54:23.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
96162024-11-09T02:54:23.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.022352ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
96172024-11-09T02:54:27.893ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56020
96182024-11-09T02:54:27.893ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56020 req_id = 20e406ef-6945-4672-9756-8bb1740c010f roles = RoleSet { roles: {} } uri = /metrics/producers
96192024-11-09T02:54:27.893ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56020 req_id = 20e406ef-6945-4672-9756-8bb1740c010f resource = Database result = Ok(()) uri = /metrics/producers
96202024-11-09T02:54:27.928ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
96212024-11-09T02:54:27.928ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35553 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56020 req_id = 20e406ef-6945-4672-9756-8bb1740c010f response_code = 201 uri = /metrics/producers
96222024-11-09T02:54:30.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1444 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 80b73050-5218-468d-b108-26eaa0c07966 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
96232024-11-09T02:54:32.049ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49013
96242024-11-09T02:54:32.049ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49013 req_id = 9ef206b2-611a-4f60-bfe5-213a6399f0c3 roles = RoleSet { roles: {} } uri = /metrics/producers
96252024-11-09T02:54:32.049ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49013 req_id = 9ef206b2-611a-4f60-bfe5-213a6399f0c3 resource = Database result = Ok(()) uri = /metrics/producers
96262024-11-09T02:54:32.088ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
96272024-11-09T02:54:32.088ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39437 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49013 req_id = 9ef206b2-611a-4f60-bfe5-213a6399f0c3 response_code = 201 uri = /metrics/producers
96282024-11-09T02:54:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
96292024-11-09T02:54:33.011ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
96302024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
96312024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
96322024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96332024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
96342024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96352024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
96362024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96372024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
96382024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
96392024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
96402024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96412024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96422024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
96432024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
96442024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
96452024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
96462024-11-09T02:54:33.012ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:44:33.012081381 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
96472024-11-09T02:54:33.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
96482024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
96492024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
96502024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96512024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
96522024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
96532024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
96542024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96552024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
96562024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
96572024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96582024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
96592024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96602024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
96612024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
96622024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96632024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
96642024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
96652024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
96662024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96672024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
96682024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
96692024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
96702024-11-09T02:54:33.012ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
96712024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.65\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
96722024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
96732024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
96742024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
96752024-11-09T02:54:33.012ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
96762024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96772024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96782024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96792024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96802024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96812024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96822024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96832024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96842024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96852024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96862024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
96872024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96882024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96892024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96902024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
96912024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
96922024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96932024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
96942024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
96952024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96962024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.321\u{b5}s iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
96972024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96982024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96992024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
97002024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.18\u{b5}s iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
97012024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 10.42\u{b5}s iteration = 17 status = {"errors":[],"records_set_to_done":[]}
97022024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 7.68\u{b5}s iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
97032024-11-09T02:54:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 350350739 } })
97042024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97052024-11-09T02:54:33.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97062024-11-09T02:54:33.012ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 350351959 } })
97072024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97082024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97092024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97102024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
97112024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
97122024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97132024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
97142024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.047112ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
97152024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97162024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
97172024-11-09T02:54:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.555592ms iteration = 10 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
97182024-11-09T02:54:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.696967ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
97192024-11-09T02:54:33.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97202024-11-09T02:54:33.015ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:44:33.012081381 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
97212024-11-09T02:54:33.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97222024-11-09T02:54:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.88501ms iteration = 9 status = {"expiration":"2024-11-09T02:44:33.012081381Z","pruned":[]}
97232024-11-09T02:54:33.017ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 354600287 } })
97242024-11-09T02:54:33.017ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
97252024-11-09T02:54:33.018ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
97262024-11-09T02:54:33.018ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97272024-11-09T02:54:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97282024-11-09T02:54:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
97292024-11-09T02:54:33.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
97302024-11-09T02:54:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
97312024-11-09T02:54:33.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97322024-11-09T02:54:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97332024-11-09T02:54:33.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 359616040 } })
97342024-11-09T02:54:33.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
97352024-11-09T02:54:33.024ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97362024-11-09T02:54:33.026ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.56947ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
97372024-11-09T02:54:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
97382024-11-09T02:54:33.027ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
97392024-11-09T02:54:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
97402024-11-09T02:54:33.027ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97412024-11-09T02:54:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97422024-11-09T02:54:33.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1376, tv_nsec: 366937042 } })
97432024-11-09T02:54:33.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
97442024-11-09T02:54:33.059ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97452024-11-09T02:54:33.060ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97462024-11-09T02:54:33.060ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97472024-11-09T02:54:33.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97482024-11-09T02:54:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97492024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97502024-11-09T02:54:33.063ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97512024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
97522024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97532024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97542024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97552024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97562024-11-09T02:54:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97572024-11-09T02:54:33.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97582024-11-09T02:54:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
97592024-11-09T02:54:33.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97602024-11-09T02:54:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97612024-11-09T02:54:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97622024-11-09T02:54:33.066ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97632024-11-09T02:54:33.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97642024-11-09T02:54:33.067ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97652024-11-09T02:54:33.067ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97662024-11-09T02:54:33.067ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 54.412724ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97672024-11-09T02:54:33.067ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-11-09T02:54:33.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97692024-11-09T02:54:33.068ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97702024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 58.797945ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97712024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97722024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97732024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97742024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97752024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
97762024-11-09T02:54:33.071ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97772024-11-09T02:54:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97782024-11-09T02:54:33.072ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97792024-11-09T02:54:33.072ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97802024-11-09T02:54:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97812024-11-09T02:54:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97822024-11-09T02:54:33.074ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97832024-11-09T02:54:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97842024-11-09T02:54:33.075ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97852024-11-09T02:54:33.075ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97862024-11-09T02:54:33.075ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97872024-11-09T02:54:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97882024-11-09T02:54:33.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.538993ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97892024-11-09T02:54:33.076ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97902024-11-09T02:54:33.076ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97912024-11-09T02:54:33.076ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 64.061474ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97922024-11-09T02:54:33.076ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97932024-11-09T02:54:33.077ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97942024-11-09T02:54:33.077ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97952024-11-09T02:54:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97962024-11-09T02:54:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97972024-11-09T02:54:33.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97982024-11-09T02:54:33.078ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97992024-11-09T02:54:33.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98002024-11-09T02:54:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98012024-11-09T02:54:33.080ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98022024-11-09T02:54:33.081ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98032024-11-09T02:54:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98042024-11-09T02:54:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
98052024-11-09T02:54:33.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
98062024-11-09T02:54:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
98072024-11-09T02:54:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
98082024-11-09T02:54:33.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
98092024-11-09T02:54:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
98102024-11-09T02:54:33.097ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
98112024-11-09T02:54:33.097ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.790532ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
98122024-11-09T02:54:33.099ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98132024-11-09T02:54:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98142024-11-09T02:54:33.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98152024-11-09T02:54:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98162024-11-09T02:54:33.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
98172024-11-09T02:54:33.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
98182024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98192024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98202024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
98212024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
98222024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
98232024-11-09T02:54:33.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98242024-11-09T02:54:33.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98252024-11-09T02:54:33.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98262024-11-09T02:54:33.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98272024-11-09T02:54:33.108ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
98282024-11-09T02:54:33.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.887092ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
98292024-11-09T02:54:33.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98302024-11-09T02:54:33.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98312024-11-09T02:54:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98322024-11-09T02:54:33.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98332024-11-09T02:54:33.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98342024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.911735ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98352024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
98362024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
98372024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
98382024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98392024-11-09T02:54:33.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98402024-11-09T02:54:33.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98412024-11-09T02:54:33.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98422024-11-09T02:54:33.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98432024-11-09T02:54:33.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98442024-11-09T02:54:33.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98452024-11-09T02:54:33.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98462024-11-09T02:54:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98472024-11-09T02:54:33.118ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98482024-11-09T02:54:33.118ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
98492024-11-09T02:54:33.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98502024-11-09T02:54:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98512024-11-09T02:54:33.123ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98522024-11-09T02:54:33.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98532024-11-09T02:54:33.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98542024-11-09T02:54:33.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98552024-11-09T02:54:33.128ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
98562024-11-09T02:54:33.128ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98572024-11-09T02:54:33.128ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
98582024-11-09T02:54:33.128ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 116.666481ms iteration = 10 status = {"generation":2}
98592024-11-09T02:54:33.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98602024-11-09T02:54:33.150ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
98612024-11-09T02:54:33.151ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 138.831209ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98622024-11-09T02:54:33.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
98632024-11-09T02:54:33.151ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
98642024-11-09T02:54:33.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
98652024-11-09T02:54:33.153ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 141.229699ms iteration = 17 status = 0
98662024-11-09T02:54:33.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98672024-11-09T02:54:33.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98682024-11-09T02:54:33.172ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
98692024-11-09T02:54:33.172ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
98702024-11-09T02:54:33.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98712024-11-09T02:54:33.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98722024-11-09T02:54:33.175ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98732024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
98742024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
98752024-11-09T02:54:33.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
98762024-11-09T02:54:33.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
98772024-11-09T02:54:33.182ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
98782024-11-09T02:54:33.182ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
98792024-11-09T02:54:33.182ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
98802024-11-09T02:54:33.182ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 170.748938ms iteration = 10 status = {"generation":1}
98812024-11-09T02:54:33.238ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98822024-11-09T02:54:33.253ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98832024-11-09T02:54:33.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 241.667095ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98842024-11-09T02:54:33.266ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98852024-11-09T02:54:33.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98862024-11-09T02:54:33.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98872024-11-09T02:54:33.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98882024-11-09T02:54:33.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98892024-11-09T02:54:33.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98902024-11-09T02:54:33.280ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 268.890647ms iteration = 19 status = {"physical_disks_added":0}
98912024-11-09T02:54:33.303ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
98922024-11-09T02:54:33.303ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98932024-11-09T02:54:33.304ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "97d81c1d-2491-4cf2-9aaf-86667ed50165", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
98942024-11-09T02:54:33.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98952024-11-09T02:54:33.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98962024-11-09T02:54:33.352ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
98972024-11-09T02:54:33.352ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98982024-11-09T02:54:33.352ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6bdab53-196d-4fa7-99e0-ffb0e2555833", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
98992024-11-09T02:54:33.352ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99002024-11-09T02:54:33.354ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
99012024-11-09T02:54:33.381ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
99022024-11-09T02:54:33.381ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "478361d6-20eb-4f6b-b991-583148c1f1c3", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99032024-11-09T02:54:33.381ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99042024-11-09T02:54:33.383ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "190e83d6-b96b-49ea-b910-23b7f94ace52", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99052024-11-09T02:54:33.383ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99062024-11-09T02:54:33.385ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
99072024-11-09T02:54:33.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 373.392746ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
99082024-11-09T02:54:33.386ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
99092024-11-09T02:54:33.386ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
99102024-11-09T02:54:33.386ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ca978a64-b36d-4501-9884-bf4dadaa090e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99112024-11-09T02:54:33.386ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
99122024-11-09T02:54:33.389ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
99132024-11-09T02:54:33.406ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
99142024-11-09T02:54:33.406ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99152024-11-09T02:54:33.406ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f6bc193-3353-4f52-b0c5-c9414a9f3720", "content-length": "372", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99162024-11-09T02:54:33.406ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99172024-11-09T02:54:33.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99182024-11-09T02:54:33.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99192024-11-09T02:54:33.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
99202024-11-09T02:54:33.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
99212024-11-09T02:54:33.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
99222024-11-09T02:54:33.423ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
99232024-11-09T02:54:33.423ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
99242024-11-09T02:54:33.424ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3c7be553-25a1-48d7-a59b-184cf7646ea0", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99252024-11-09T02:54:33.424ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99262024-11-09T02:54:33.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99272024-11-09T02:54:33.427ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99282024-11-09T02:54:33.427ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99292024-11-09T02:54:33.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
99302024-11-09T02:54:33.431ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
99312024-11-09T02:54:33.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
99322024-11-09T02:54:33.435ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
99332024-11-09T02:54:33.435ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
99342024-11-09T02:54:33.435ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1fe08157-81a7-4a53-aba9-15ba797d8f1f", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99352024-11-09T02:54:33.437ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 425.812559ms iteration = 18 status = {}
99362024-11-09T02:54:33.444ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
99372024-11-09T02:54:33.445ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e16b200d-642c-4118-b955-4e910504a6d9", "content-length": "1", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99382024-11-09T02:54:33.447ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
99392024-11-09T02:54:33.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
99402024-11-09T02:54:33.449ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 437.529102ms iteration = 17 status = null
99412024-11-09T02:54:33.484ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 472.510175ms iteration = 17 status = {}
99422024-11-09T02:54:33.554ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
99432024-11-09T02:54:33.555ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "8b91cc0d-040f-45c1-be69-eb45519e9876", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99442024-11-09T02:54:33.555ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99452024-11-09T02:54:33.557ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3ded0e7f-4ec0-4efb-807b-c00a782015f8", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99462024-11-09T02:54:33.557ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99472024-11-09T02:54:33.558ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "156e1c8e-2c9d-495a-a607-021c3e670562", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99482024-11-09T02:54:33.558ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99492024-11-09T02:54:33.561ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
99502024-11-09T02:54:33.561ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 549.428794ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
99512024-11-09T02:54:33.596ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99522024-11-09T02:54:33.596ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "f2f07366-4a71-4e48-b76b-c1fbd0de0ada", "content-length": "691", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99532024-11-09T02:54:33.596ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
99542024-11-09T02:54:33.596ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
99552024-11-09T02:54:33.596ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
99562024-11-09T02:54:33.599ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 587.545683ms iteration = 17 status = {}
99572024-11-09T02:54:33.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99582024-11-09T02:54:33.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99592024-11-09T02:54:33.619ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
99602024-11-09T02:54:33.619ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99612024-11-09T02:54:33.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99622024-11-09T02:54:33.629ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99632024-11-09T02:54:33.629ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e9ed5d4-4c47-49f8-b23b-5a4370a7caaf", "content-length": "134", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99642024-11-09T02:54:33.629ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99652024-11-09T02:54:33.629ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
99662024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99672024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99682024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99692024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99702024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99712024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99722024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99732024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99742024-11-09T02:54:33.630ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
99752024-11-09T02:54:33.630ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99762024-11-09T02:54:33.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99772024-11-09T02:54:33.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99782024-11-09T02:54:33.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "2dd6986c-89cf-4887-a898-f3a3a0ccd98e", "content-length": "2", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99792024-11-09T02:54:33.633ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99802024-11-09T02:54:33.633ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "55c439d6-4993-4fa9-a7af-d0f5d6d27402", "content-length": "52", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99812024-11-09T02:54:33.633ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
99822024-11-09T02:54:33.633ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99832024-11-09T02:54:33.940ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "16076451-92e8-4df2-a772-71a837cb176d", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99842024-11-09T02:54:33.940ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
99852024-11-09T02:54:33.940ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99862024-11-09T02:54:33.941ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c5f4ac-d336-4a4a-a12e-c7165e5a007a", "content-length": "682", "date": "Sat, 09 Nov 2024 02:54:33 GMT"} })
99872024-11-09T02:54:33.941ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99882024-11-09T02:54:33.941ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99892024-11-09T02:54:33.944ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99902024-11-09T02:54:33.944ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99912024-11-09T02:54:33.947ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99922024-11-09T02:54:33.947ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99932024-11-09T02:54:33.949ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99942024-11-09T02:54:33.950ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99952024-11-09T02:54:33.956ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 944.800186ms iteration = 17 status = {}
99962024-11-09T02:54:40.104ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
99972024-11-09T02:54:40.104ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
99982024-11-09T02:54:40.135ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
99992024-11-09T02:54:40.135ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:55692
100002024-11-09T02:54:40.135ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55692 req_id = c350dcd0-5221-400a-8394-39e58a10216f roles = RoleSet { roles: {} } uri = /metrics/producers
100012024-11-09T02:54:40.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55692 req_id = c350dcd0-5221-400a-8394-39e58a10216f resource = Database result = Ok(()) uri = /metrics/producers
100022024-11-09T02:54:40.153ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
100032024-11-09T02:54:40.153ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 17481 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:55692 req_id = c350dcd0-5221-400a-8394-39e58a10216f response_code = 201 uri = /metrics/producers
100042024-11-09T02:54:40.153ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "c350dcd0-5221-400a-8394-39e58a10216f", "content-length": "41", "date": "Sat, 09 Nov 2024 02:54:40 GMT"} })
100052024-11-09T02:54:40.155ZDEBGnexus (producer-registration-task): registered with nexus successfully
100062024-11-09T02:54:40.155ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
100072024-11-09T02:54:43.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
100082024-11-09T02:54:43.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100092024-11-09T02:54:43.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
100102024-11-09T02:54:43.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100112024-11-09T02:54:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100122024-11-09T02:54:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100132024-11-09T02:54:43.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100142024-11-09T02:54:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100152024-11-09T02:54:43.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100162024-11-09T02:54:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100172024-11-09T02:54:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100182024-11-09T02:54:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100192024-11-09T02:54:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100202024-11-09T02:54:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
100212024-11-09T02:54:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100222024-11-09T02:54:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100232024-11-09T02:54:43.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
100242024-11-09T02:54:43.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.160428ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
100252024-11-09T02:54:43.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100262024-11-09T02:54:43.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100272024-11-09T02:54:43.044ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.280907ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100282024-11-09T02:54:45.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1573 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 0f612304-b190-4b0d-9766-c412bf4de21a response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
100292024-11-09T02:54:50.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 72cd47b7-603b-4dad-9df4-c5b001ae0bc2 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
100302024-11-09T02:54:50.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 72cd47b7-603b-4dad-9df4-c5b001ae0bc2 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
100312024-11-09T02:54:50.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 72cd47b7-603b-4dad-9df4-c5b001ae0bc2 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
100322024-11-09T02:54:50.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = ae64c9d4-014c-4fe8-8d73-2a2891379940 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
100332024-11-09T02:54:50.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = ae64c9d4-014c-4fe8-8d73-2a2891379940 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
100342024-11-09T02:54:50.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2031 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = ae64c9d4-014c-4fe8-8d73-2a2891379940 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
100352024-11-09T02:54:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
100362024-11-09T02:54:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100372024-11-09T02:54:53.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
100382024-11-09T02:54:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100392024-11-09T02:54:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100402024-11-09T02:54:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100412024-11-09T02:54:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100422024-11-09T02:54:53.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100432024-11-09T02:54:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100442024-11-09T02:54:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100452024-11-09T02:54:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100462024-11-09T02:54:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100472024-11-09T02:54:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100482024-11-09T02:54:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
100492024-11-09T02:54:53.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100502024-11-09T02:54:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100512024-11-09T02:54:53.036ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
100522024-11-09T02:54:53.036ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.940915ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
100532024-11-09T02:54:53.046ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100542024-11-09T02:54:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100552024-11-09T02:54:53.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.076574ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
100562024-11-09T02:55:00.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1122 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = db2b14e3-8053-4ace-bbbe-a88f7a54090a response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
100572024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
100582024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100592024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
100602024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
100612024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100622024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
100632024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100642024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100652024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100662024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
100672024-11-09T02:55:03.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100682024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100692024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
100702024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
100712024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100722024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
100732024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
100742024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100752024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100762024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
100772024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100782024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
100792024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100802024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
100812024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
100822024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100832024-11-09T02:55:03.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100842024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100852024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100862024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100872024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100882024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100892024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100902024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100912024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100922024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100932024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100942024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100952024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100962024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
100972024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 14.491\u{b5}s iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
100982024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
100992024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
101002024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.7\u{b5}s iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
101012024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.41\u{b5}s iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101022024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
101032024-11-09T02:55:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.49\u{b5}s iteration = 18 status = {"errors":[],"records_set_to_done":[]}
101042024-11-09T02:55:03.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101052024-11-09T02:55:03.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101062024-11-09T02:55:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.301029ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
101072024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101082024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101092024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101102024-11-09T02:55:03.017ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101112024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
101122024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101132024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101142024-11-09T02:55:03.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101152024-11-09T02:55:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101162024-11-09T02:55:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101172024-11-09T02:55:03.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101182024-11-09T02:55:03.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101192024-11-09T02:55:03.020ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 357859854 } })
101202024-11-09T02:55:03.020ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
101212024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
101222024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
101232024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
101242024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
101252024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
101262024-11-09T02:55:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
101272024-11-09T02:55:03.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101282024-11-09T02:55:03.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101292024-11-09T02:55:03.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101302024-11-09T02:55:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101312024-11-09T02:55:03.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 364260796 } })
101322024-11-09T02:55:03.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
101332024-11-09T02:55:03.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101342024-11-09T02:55:03.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101352024-11-09T02:55:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101362024-11-09T02:55:03.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101372024-11-09T02:55:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101382024-11-09T02:55:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101392024-11-09T02:55:03.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1406, tv_nsec: 366092434 } })
101402024-11-09T02:55:03.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
101412024-11-09T02:55:03.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101422024-11-09T02:55:03.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101432024-11-09T02:55:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101442024-11-09T02:55:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101452024-11-09T02:55:03.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101462024-11-09T02:55:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101472024-11-09T02:55:03.037ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101482024-11-09T02:55:03.037ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 25.198541ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101492024-11-09T02:55:03.044ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 31.514782ms iteration = 20 status = {"physical_disks_added":0}
101502024-11-09T02:55:03.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101512024-11-09T02:55:03.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101522024-11-09T02:55:03.050ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 38.491816ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101532024-11-09T02:55:03.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101542024-11-09T02:55:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101552024-11-09T02:55:03.056ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101562024-11-09T02:55:03.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101572024-11-09T02:55:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101582024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
101592024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101602024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101612024-11-09T02:55:03.059ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101622024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101632024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101642024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101652024-11-09T02:55:03.059ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
101662024-11-09T02:55:03.060ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
101672024-11-09T02:55:03.061ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101682024-11-09T02:55:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101692024-11-09T02:55:03.068ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101702024-11-09T02:55:03.072ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
101712024-11-09T02:55:03.072ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
101722024-11-09T02:55:03.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
101732024-11-09T02:55:03.084ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
101742024-11-09T02:55:03.085ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 72.539409ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
101752024-11-09T02:55:03.095ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101762024-11-09T02:55:03.095ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101772024-11-09T02:55:03.095ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 83.016626ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101782024-11-09T02:55:03.096ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 84.293102ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101792024-11-09T02:55:03.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101802024-11-09T02:55:03.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
101812024-11-09T02:55:03.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101822024-11-09T02:55:03.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101832024-11-09T02:55:03.103ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 91.111183ms iteration = 18 status = 0
101842024-11-09T02:55:03.115ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
101852024-11-09T02:55:03.115ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101862024-11-09T02:55:03.115ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a8e28d48-c5a6-42a9-8b2f-01e5856df9e0", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
101872024-11-09T02:55:03.115ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101882024-11-09T02:55:03.117ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101892024-11-09T02:55:03.118ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101902024-11-09T02:55:03.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101912024-11-09T02:55:03.131ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
101922024-11-09T02:55:03.131ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101932024-11-09T02:55:03.131ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d8efc0a-9a6a-4491-a1cf-5c59a2de9d49", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
101942024-11-09T02:55:03.131ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101952024-11-09T02:55:03.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
101962024-11-09T02:55:03.132ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101972024-11-09T02:55:03.132ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56076a92-27d2-4cb8-8177-e77b0980b7c9", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
101982024-11-09T02:55:03.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101992024-11-09T02:55:03.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
102002024-11-09T02:55:03.134ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
102012024-11-09T02:55:03.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102022024-11-09T02:55:03.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102032024-11-09T02:55:03.240ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102042024-11-09T02:55:03.243ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102052024-11-09T02:55:03.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102062024-11-09T02:55:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102072024-11-09T02:55:03.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102082024-11-09T02:55:03.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
102092024-11-09T02:55:03.248ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
102102024-11-09T02:55:03.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
102112024-11-09T02:55:03.388ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
102122024-11-09T02:55:03.388ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e27a609b-e202-4321-83b7-d600180a815a", "content-length": "691", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102132024-11-09T02:55:03.388ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
102142024-11-09T02:55:03.388ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
102152024-11-09T02:55:03.388ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
102162024-11-09T02:55:03.390ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.495081ms iteration = 18 status = {}
102172024-11-09T02:55:03.441ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
102182024-11-09T02:55:03.441ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102192024-11-09T02:55:03.442ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddc511e3-2a5f-4c8f-b5d6-7aa91b94cd1e", "content-length": "372", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102202024-11-09T02:55:03.442ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102212024-11-09T02:55:03.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102222024-11-09T02:55:03.445ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
102232024-11-09T02:55:03.445ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "0247fdbc-732d-4717-98d2-74c4ca5feb3e", "content-length": "1", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
102242024-11-09T02:55:03.447ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
102252024-11-09T02:55:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
102262024-11-09T02:55:03.448ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 436.176703ms iteration = 18 status = null
102272024-11-09T02:55:03.453ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 441.019654ms iteration = 18 status = {}
102282024-11-09T02:55:03.457ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
102292024-11-09T02:55:03.457ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
102302024-11-09T02:55:03.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102312024-11-09T02:55:03.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102322024-11-09T02:55:03.468ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
102332024-11-09T02:55:03.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102342024-11-09T02:55:03.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102352024-11-09T02:55:03.477ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102362024-11-09T02:55:03.477ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d25eef9-b1f3-46a8-ad5f-01bed37677f6", "content-length": "134", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
102372024-11-09T02:55:03.477ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102382024-11-09T02:55:03.477ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
102392024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102402024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102412024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102422024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102432024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102442024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102452024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102462024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102472024-11-09T02:55:03.478ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
102482024-11-09T02:55:03.478ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102492024-11-09T02:55:03.478ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102502024-11-09T02:55:03.480ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102512024-11-09T02:55:03.480ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2110cb4-743c-4260-a79e-a72723f5fffc", "content-length": "2", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
102522024-11-09T02:55:03.480ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102532024-11-09T02:55:03.480ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "89a15a54-5d2d-4af9-a8fa-edb511594c37", "content-length": "52", "date": "Sat, 09 Nov 2024 02:55:02 GMT"} })
102542024-11-09T02:55:03.480ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
102552024-11-09T02:55:03.480ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102562024-11-09T02:55:03.569ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b23049e9-906e-4d0f-a567-5072557a868b", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102572024-11-09T02:55:03.569ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102582024-11-09T02:55:03.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102592024-11-09T02:55:03.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102602024-11-09T02:55:03.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102612024-11-09T02:55:03.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102622024-11-09T02:55:03.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102632024-11-09T02:55:03.579ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102642024-11-09T02:55:03.579ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102652024-11-09T02:55:03.580ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "06937b12-966b-4367-a910-83506766da47", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102662024-11-09T02:55:03.581ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 568.911817ms iteration = 19 status = {}
102672024-11-09T02:55:03.772ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5e5eb983-222a-4b2c-acb5-bd9f76b98682", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102682024-11-09T02:55:03.772ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
102692024-11-09T02:55:03.772ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102702024-11-09T02:55:03.772ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a38693e2-9a88-4b85-8b24-c608bea7a20a", "content-length": "682", "date": "Sat, 09 Nov 2024 02:55:03 GMT"} })
102712024-11-09T02:55:03.772ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102722024-11-09T02:55:03.773ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102732024-11-09T02:55:03.776ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102742024-11-09T02:55:03.776ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102752024-11-09T02:55:03.779ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102762024-11-09T02:55:03.780ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102772024-11-09T02:55:03.782ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102782024-11-09T02:55:03.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102792024-11-09T02:55:03.789ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 777.084639ms iteration = 18 status = {}
102802024-11-09T02:55:05.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f214baec-646c-420e-9add-4cf6afea36ef roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
102812024-11-09T02:55:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f214baec-646c-420e-9add-4cf6afea36ef resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
102822024-11-09T02:55:05.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3040 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f214baec-646c-420e-9add-4cf6afea36ef response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
102832024-11-09T02:55:05.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f88d9044-a374-4a39-ab5f-83042f9cca7a roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
102842024-11-09T02:55:05.147ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f88d9044-a374-4a39-ab5f-83042f9cca7a resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
102852024-11-09T02:55:05.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2325 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f88d9044-a374-4a39-ab5f-83042f9cca7a response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
102862024-11-09T02:55:13.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
102872024-11-09T02:55:13.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102882024-11-09T02:55:13.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
102892024-11-09T02:55:13.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102902024-11-09T02:55:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102912024-11-09T02:55:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102922024-11-09T02:55:13.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102932024-11-09T02:55:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102942024-11-09T02:55:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102952024-11-09T02:55:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102962024-11-09T02:55:13.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102972024-11-09T02:55:13.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102982024-11-09T02:55:13.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102992024-11-09T02:55:13.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
103002024-11-09T02:55:13.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103012024-11-09T02:55:13.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103022024-11-09T02:55:13.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
103032024-11-09T02:55:13.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.542757ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
103042024-11-09T02:55:13.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103052024-11-09T02:55:13.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103062024-11-09T02:55:13.076ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.313569ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103072024-11-09T02:55:15.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1378 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 80125ba1-f2bb-4bb9-82f2-a09881eb5004 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
103082024-11-09T02:55:20.143ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3bb16b4f-8225-45db-9cbf-54504ea3293e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
103092024-11-09T02:55:20.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3bb16b4f-8225-45db-9cbf-54504ea3293e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
103102024-11-09T02:55:20.146ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2523 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3bb16b4f-8225-45db-9cbf-54504ea3293e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
103112024-11-09T02:55:20.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = cc9ca91d-ffee-4ea8-88e5-1cefb5b58db4 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
103122024-11-09T02:55:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = cc9ca91d-ffee-4ea8-88e5-1cefb5b58db4 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
103132024-11-09T02:55:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2382 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = cc9ca91d-ffee-4ea8-88e5-1cefb5b58db4 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
103142024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
103152024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103162024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
103172024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103182024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103192024-11-09T02:55:23.012ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103202024-11-09T02:55:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103212024-11-09T02:55:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103222024-11-09T02:55:23.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103232024-11-09T02:55:23.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.635145ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
103242024-11-09T02:55:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103252024-11-09T02:55:23.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103262024-11-09T02:55:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103272024-11-09T02:55:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103282024-11-09T02:55:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103292024-11-09T02:55:23.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103302024-11-09T02:55:23.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
103312024-11-09T02:55:23.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103322024-11-09T02:55:23.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103332024-11-09T02:55:23.031ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
103342024-11-09T02:55:23.031ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 19.757619ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
103352024-11-09T02:55:30.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1548 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = c997e26b-ab35-46be-8e74-344e3e0ebac2 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
103362024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
103372024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
103382024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
103392024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103402024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103412024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
103422024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
103432024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103442024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
103452024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
103462024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103472024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
103482024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
103492024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103502024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
103512024-11-09T02:55:33.012ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
103522024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103532024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103542024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
103552024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103562024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
103572024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
103582024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103592024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
103602024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
103612024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
103622024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103632024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103642024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
103652024-11-09T02:55:33.012ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:45:33.012664474 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
103662024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
103672024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
103682024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103692024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
103702024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
103712024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103722024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
103732024-11-09T02:55:33.012ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103742024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103752024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
103762024-11-09T02:55:33.012ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
103772024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.571\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
103782024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
103792024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103802024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
103812024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103822024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
103832024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
103842024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
103852024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103862024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
103872024-11-09T02:55:33.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103882024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103892024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103902024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103912024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103922024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103932024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103942024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103952024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103962024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103972024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103982024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
103992024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104002024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104012024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104022024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104032024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
104042024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104052024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104062024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
104072024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
104082024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
104092024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
104102024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
104112024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
104122024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 8.41\u{b5}s iteration = 19 status = {"errors":[],"records_set_to_done":[]}
104132024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
104142024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
104152024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 5.34\u{b5}s iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
104162024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
104172024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.14\u{b5}s iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
104182024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 4.55\u{b5}s iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
104192024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104202024-11-09T02:55:33.013ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 350459101 } })
104212024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104222024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104232024-11-09T02:55:33.013ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 350504002 } })
104242024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104252024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
104262024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
104272024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104282024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104292024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104302024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
104312024-11-09T02:55:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.426339ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
104322024-11-09T02:55:33.014ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
104332024-11-09T02:55:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104342024-11-09T02:55:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.4627ms iteration = 11 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
104352024-11-09T02:55:33.015ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104362024-11-09T02:55:33.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104372024-11-09T02:55:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104382024-11-09T02:55:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.231828ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104392024-11-09T02:55:33.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104402024-11-09T02:55:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104412024-11-09T02:55:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
104422024-11-09T02:55:33.017ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104432024-11-09T02:55:33.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104442024-11-09T02:55:33.019ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104452024-11-09T02:55:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104462024-11-09T02:55:33.019ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104472024-11-09T02:55:33.020ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:45:33.012664474 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
104482024-11-09T02:55:33.020ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 7.547556ms iteration = 10 status = {"expiration":"2024-11-09T02:45:33.012664474Z","pruned":[]}
104492024-11-09T02:55:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104502024-11-09T02:55:33.022ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104512024-11-09T02:55:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104522024-11-09T02:55:33.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104532024-11-09T02:55:33.025ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
104542024-11-09T02:55:33.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
104552024-11-09T02:55:33.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104562024-11-09T02:55:33.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 362834137 } })
104572024-11-09T02:55:33.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
104582024-11-09T02:55:33.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 364069112 } })
104592024-11-09T02:55:33.027ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104602024-11-09T02:55:33.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104612024-11-09T02:55:33.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
104622024-11-09T02:55:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104632024-11-09T02:55:33.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104642024-11-09T02:55:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104652024-11-09T02:55:33.029ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104662024-11-09T02:55:33.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104672024-11-09T02:55:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104682024-11-09T02:55:33.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104692024-11-09T02:55:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104702024-11-09T02:55:33.030ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104712024-11-09T02:55:33.031ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.304608ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
104722024-11-09T02:55:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104732024-11-09T02:55:33.034ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104742024-11-09T02:55:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104752024-11-09T02:55:33.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104762024-11-09T02:55:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104772024-11-09T02:55:33.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104782024-11-09T02:55:33.037ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 25.351774ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
104792024-11-09T02:55:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104802024-11-09T02:55:33.039ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104812024-11-09T02:55:33.039ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104822024-11-09T02:55:33.040ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104832024-11-09T02:55:33.041ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104842024-11-09T02:55:33.041ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104852024-11-09T02:55:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104862024-11-09T02:55:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
104872024-11-09T02:55:33.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
104882024-11-09T02:55:33.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104892024-11-09T02:55:33.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104902024-11-09T02:55:33.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104912024-11-09T02:55:33.052ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104922024-11-09T02:55:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
104932024-11-09T02:55:33.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104942024-11-09T02:55:33.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104952024-11-09T02:55:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104962024-11-09T02:55:33.054ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104972024-11-09T02:55:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104982024-11-09T02:55:33.056ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104992024-11-09T02:55:33.056ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105002024-11-09T02:55:33.056ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
105012024-11-09T02:55:33.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105022024-11-09T02:55:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105032024-11-09T02:55:33.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105042024-11-09T02:55:33.061ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105052024-11-09T02:55:33.065ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105062024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
105072024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
105082024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
105092024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105102024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105112024-11-09T02:55:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105122024-11-09T02:55:33.068ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105132024-11-09T02:55:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105142024-11-09T02:55:33.071ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105152024-11-09T02:55:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105162024-11-09T02:55:33.072ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
105172024-11-09T02:55:33.072ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.536891ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
105182024-11-09T02:55:33.074ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105192024-11-09T02:55:33.074ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105202024-11-09T02:55:33.074ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 60.676414ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105212024-11-09T02:55:33.074ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105222024-11-09T02:55:33.074ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105232024-11-09T02:55:33.074ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105242024-11-09T02:55:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
105252024-11-09T02:55:33.077ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
105262024-11-09T02:55:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
105272024-11-09T02:55:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
105282024-11-09T02:55:33.077ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
105292024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105302024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
105312024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
105322024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
105332024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105342024-11-09T02:55:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105352024-11-09T02:55:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
105362024-11-09T02:55:33.080ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105372024-11-09T02:55:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105382024-11-09T02:55:33.081ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 68.850892ms iteration = 5 status = {"nsuccess":5}
105392024-11-09T02:55:33.081ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1436, tv_nsec: 418891165 } })
105402024-11-09T02:55:33.082ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
105412024-11-09T02:55:33.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105422024-11-09T02:55:33.084ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105432024-11-09T02:55:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105442024-11-09T02:55:33.086ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
105452024-11-09T02:55:33.086ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
105462024-11-09T02:55:33.086ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
105472024-11-09T02:55:33.086ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105482024-11-09T02:55:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105492024-11-09T02:55:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105502024-11-09T02:55:33.087ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105512024-11-09T02:55:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105522024-11-09T02:55:33.088ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105532024-11-09T02:55:33.089ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
105542024-11-09T02:55:33.090ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
105552024-11-09T02:55:33.090ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105562024-11-09T02:55:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105572024-11-09T02:55:33.091ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
105582024-11-09T02:55:33.091ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
105592024-11-09T02:55:33.091ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 78.531743ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
105602024-11-09T02:55:33.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105612024-11-09T02:55:33.091ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105622024-11-09T02:55:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105632024-11-09T02:55:33.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105642024-11-09T02:55:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105652024-11-09T02:55:33.093ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105662024-11-09T02:55:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105672024-11-09T02:55:33.094ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105682024-11-09T02:55:33.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105692024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105702024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105712024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105722024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105732024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105742024-11-09T02:55:33.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105752024-11-09T02:55:33.097ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105762024-11-09T02:55:33.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105772024-11-09T02:55:33.098ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105782024-11-09T02:55:33.098ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 85.891495ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105792024-11-09T02:55:33.100ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
105802024-11-09T02:55:33.100ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
105812024-11-09T02:55:33.100ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
105822024-11-09T02:55:33.100ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 87.467948ms iteration = 11 status = {"generation":1}
105832024-11-09T02:55:33.100ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105842024-11-09T02:55:33.103ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
105852024-11-09T02:55:33.103ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105862024-11-09T02:55:33.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105872024-11-09T02:55:33.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105882024-11-09T02:55:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105892024-11-09T02:55:33.107ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105902024-11-09T02:55:33.107ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 95.116356ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
105912024-11-09T02:55:33.109ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
105922024-11-09T02:55:33.109ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105932024-11-09T02:55:33.109ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105942024-11-09T02:55:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105952024-11-09T02:55:33.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105962024-11-09T02:55:33.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105972024-11-09T02:55:33.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105982024-11-09T02:55:33.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 99.235451ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105992024-11-09T02:55:33.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106002024-11-09T02:55:33.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106012024-11-09T02:55:33.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106022024-11-09T02:55:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
106032024-11-09T02:55:33.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106042024-11-09T02:55:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106052024-11-09T02:55:33.118ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 105.858888ms iteration = 19 status = 0
106062024-11-09T02:55:33.131ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
106072024-11-09T02:55:33.131ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
106082024-11-09T02:55:33.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106092024-11-09T02:55:33.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106102024-11-09T02:55:33.133ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106112024-11-09T02:55:33.134ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
106122024-11-09T02:55:33.134ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 121.714885ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
106132024-11-09T02:55:33.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106142024-11-09T02:55:33.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106152024-11-09T02:55:33.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106162024-11-09T02:55:33.149ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
106172024-11-09T02:55:33.166ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
106182024-11-09T02:55:33.166ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 153.765998ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
106192024-11-09T02:55:33.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106202024-11-09T02:55:33.177ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
106212024-11-09T02:55:33.177ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106222024-11-09T02:55:33.177ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d90b0d25-e21e-47b0-a661-1d6a86d5b233", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:32 GMT"} })
106232024-11-09T02:55:33.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106242024-11-09T02:55:33.177ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106252024-11-09T02:55:33.179ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106262024-11-09T02:55:33.237ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 224.563841ms iteration = 21 status = {"physical_disks_added":0}
106272024-11-09T02:55:33.258ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
106282024-11-09T02:55:33.258ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106292024-11-09T02:55:33.258ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f0f4bac-8233-43fd-a2f3-d7ef6e7c29c5", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:32 GMT"} })
106302024-11-09T02:55:33.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106312024-11-09T02:55:33.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
106322024-11-09T02:55:33.264ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
106332024-11-09T02:55:33.358ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106342024-11-09T02:55:33.358ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "8c49bb8d-82a1-48f1-8584-d437d20e7f66", "content-length": "1", "date": "Sat, 09 Nov 2024 02:55:32 GMT"} })
106352024-11-09T02:55:33.361ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
106362024-11-09T02:55:33.361ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
106372024-11-09T02:55:33.361ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "117a5d0a-5a24-47aa-92bc-7505b171ebcd", "content-length": "26", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
106382024-11-09T02:55:33.361ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
106392024-11-09T02:55:33.362ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106402024-11-09T02:55:33.362ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106412024-11-09T02:55:33.364ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
106422024-11-09T02:55:33.376ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
106432024-11-09T02:55:33.376ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106442024-11-09T02:55:33.377ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "9a50d4ab-448f-493f-ba60-67ca843ddf6f", "content-length": "372", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
106452024-11-09T02:55:33.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106462024-11-09T02:55:33.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106472024-11-09T02:55:33.379ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
106482024-11-09T02:55:33.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "f6c28dae-bf1a-42dd-a17c-0f7032d47862", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106492024-11-09T02:55:33.380ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106502024-11-09T02:55:33.381ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
106512024-11-09T02:55:33.381ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
106522024-11-09T02:55:33.381ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
106532024-11-09T02:55:33.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 368.682998ms iteration = 11 status = {"generation":2}
106542024-11-09T02:55:33.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106552024-11-09T02:55:33.382ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "caa19098-c560-4680-992a-c30f299ea5aa", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106562024-11-09T02:55:33.382ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106572024-11-09T02:55:33.383ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 370.872824ms iteration = 19 status = null
106582024-11-09T02:55:33.385ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106592024-11-09T02:55:33.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 372.694302ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
106602024-11-09T02:55:33.385ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106612024-11-09T02:55:33.385ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106622024-11-09T02:55:33.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106632024-11-09T02:55:33.388ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106642024-11-09T02:55:33.391ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106652024-11-09T02:55:33.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106662024-11-09T02:55:33.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106672024-11-09T02:55:33.408ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
106682024-11-09T02:55:33.408ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106692024-11-09T02:55:33.408ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "ff6329de-a57d-428c-ab40-846e3bb75e46", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
106702024-11-09T02:55:33.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106712024-11-09T02:55:33.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106722024-11-09T02:55:33.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106732024-11-09T02:55:33.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106742024-11-09T02:55:33.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106752024-11-09T02:55:33.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106762024-11-09T02:55:33.418ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106772024-11-09T02:55:33.418ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106782024-11-09T02:55:33.419ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b9351acb-b096-485f-a4ed-560ae56612d2", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
106792024-11-09T02:55:33.421ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 408.734186ms iteration = 20 status = {}
106802024-11-09T02:55:33.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
106812024-11-09T02:55:33.461ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 448.533409ms iteration = 19 status = {}
106822024-11-09T02:55:33.510ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
106832024-11-09T02:55:33.511ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "85c57a59-6517-4ba6-80ac-c7d484c921a2", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106842024-11-09T02:55:33.511ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106852024-11-09T02:55:33.512ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "5f9d0475-600f-4511-9bf9-d05f52341ade", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106862024-11-09T02:55:33.512ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106872024-11-09T02:55:33.514ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3e51e3ae-3c87-488e-93e9-6bb3e9a9aaaf", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106882024-11-09T02:55:33.514ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106892024-11-09T02:55:33.516ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
106902024-11-09T02:55:33.516ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 504.512716ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
106912024-11-09T02:55:33.548ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106922024-11-09T02:55:33.549ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8415f5bb-c121-4044-aba3-f6c6795a14ef", "content-length": "691", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
106932024-11-09T02:55:33.549ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
106942024-11-09T02:55:33.549ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
106952024-11-09T02:55:33.549ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
106962024-11-09T02:55:33.550ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 538.176722ms iteration = 19 status = {}
106972024-11-09T02:55:33.559ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106982024-11-09T02:55:33.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106992024-11-09T02:55:33.562ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
107002024-11-09T02:55:33.562ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107012024-11-09T02:55:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107022024-11-09T02:55:33.571ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
107032024-11-09T02:55:33.572ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "15af9e3e-4d41-4f04-b579-fd895e1c0601", "content-length": "134", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
107042024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107052024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
107062024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107072024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107082024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107092024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107102024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107112024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107122024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107132024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107142024-11-09T02:55:33.572ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
107152024-11-09T02:55:33.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107162024-11-09T02:55:33.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107172024-11-09T02:55:33.574ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107182024-11-09T02:55:33.574ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c28a63f3-8143-48c4-a776-e93a6affbd17", "content-length": "2", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
107192024-11-09T02:55:33.574ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107202024-11-09T02:55:33.574ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "52eb26c4-87ea-4051-9970-f9e2e0d33479", "content-length": "52", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
107212024-11-09T02:55:33.574ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
107222024-11-09T02:55:33.574ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107232024-11-09T02:55:33.690ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "98ada1dd-1794-4c7a-a42b-e9feb68e8554", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
107242024-11-09T02:55:33.690ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
107252024-11-09T02:55:33.690ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107262024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d11ab68-1bb4-4c11-a715-67875601e3eb", "content-length": "682", "date": "Sat, 09 Nov 2024 02:55:33 GMT"} })
107272024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107282024-11-09T02:55:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107292024-11-09T02:55:33.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107302024-11-09T02:55:33.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107312024-11-09T02:55:33.699ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107322024-11-09T02:55:33.699ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107332024-11-09T02:55:33.701ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107342024-11-09T02:55:33.701ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107352024-11-09T02:55:33.708ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 695.997193ms iteration = 19 status = {}
107362024-11-09T02:55:43.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
107372024-11-09T02:55:43.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107382024-11-09T02:55:43.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
107392024-11-09T02:55:43.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107402024-11-09T02:55:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107412024-11-09T02:55:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107422024-11-09T02:55:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107432024-11-09T02:55:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107442024-11-09T02:55:43.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107452024-11-09T02:55:43.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107462024-11-09T02:55:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107472024-11-09T02:55:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107482024-11-09T02:55:43.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107492024-11-09T02:55:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
107502024-11-09T02:55:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107512024-11-09T02:55:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107522024-11-09T02:55:43.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
107532024-11-09T02:55:43.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.874723ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
107542024-11-09T02:55:43.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107552024-11-09T02:55:43.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107562024-11-09T02:55:43.068ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.260233ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107572024-11-09T02:55:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1572 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = a511efc0-8a78-40a1-81b5-a6b72ad74936 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
107582024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
107592024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
107602024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107612024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107622024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107632024-11-09T02:55:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107642024-11-09T02:55:53.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107652024-11-09T02:55:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107662024-11-09T02:55:53.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107672024-11-09T02:55:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107682024-11-09T02:55:53.047ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107692024-11-09T02:55:53.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107702024-11-09T02:55:53.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107712024-11-09T02:55:53.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107722024-11-09T02:55:53.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107732024-11-09T02:55:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
107742024-11-09T02:55:53.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107752024-11-09T02:55:53.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107762024-11-09T02:55:53.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
107772024-11-09T02:55:53.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.547906ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
107782024-11-09T02:55:53.077ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.513374ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107792024-11-09T02:56:00.151ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1353 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 5f0b9dcf-3058-43c1-81ef-a89285945ca7 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
107802024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
107812024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107822024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
107832024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
107842024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107852024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107862024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107872024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
107882024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
107892024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
107902024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
107912024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
107922024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
107932024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107942024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
107952024-11-09T02:56:03.013ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
107962024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
107972024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
107982024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
107992024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
108002024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108012024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
108022024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
108032024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
108042024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
108052024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108062024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108072024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
108082024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 11.38\u{b5}s iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
108092024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
108102024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.41\u{b5}s iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
108112024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
108122024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
108132024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.64\u{b5}s iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
108142024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 17.48\u{b5}s iteration = 20 status = {"errors":[],"records_set_to_done":[]}
108152024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108162024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108172024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108182024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108192024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108202024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108212024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108222024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108232024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108242024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108252024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108262024-11-09T02:56:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108272024-11-09T02:56:03.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108282024-11-09T02:56:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108292024-11-09T02:56:03.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108302024-11-09T02:56:03.017ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.926111ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108312024-11-09T02:56:03.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108322024-11-09T02:56:03.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108332024-11-09T02:56:03.017ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108342024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
108352024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108362024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108372024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108382024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108392024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108402024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108412024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108422024-11-09T02:56:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108432024-11-09T02:56:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108442024-11-09T02:56:03.021ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108452024-11-09T02:56:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108462024-11-09T02:56:03.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108472024-11-09T02:56:03.024ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 361141992 } })
108482024-11-09T02:56:03.024ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 11.327424ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
108492024-11-09T02:56:03.024ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
108502024-11-09T02:56:03.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108512024-11-09T02:56:03.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 362262665 } })
108522024-11-09T02:56:03.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
108532024-11-09T02:56:03.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108542024-11-09T02:56:03.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108552024-11-09T02:56:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108562024-11-09T02:56:03.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108572024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108582024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108592024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108602024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108612024-11-09T02:56:03.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1466, tv_nsec: 367333090 } })
108622024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108632024-11-09T02:56:03.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
108642024-11-09T02:56:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108652024-11-09T02:56:03.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108662024-11-09T02:56:03.032ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108672024-11-09T02:56:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108682024-11-09T02:56:03.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108692024-11-09T02:56:03.034ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108702024-11-09T02:56:03.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108712024-11-09T02:56:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108722024-11-09T02:56:03.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108732024-11-09T02:56:03.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108742024-11-09T02:56:03.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108752024-11-09T02:56:03.049ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108762024-11-09T02:56:03.049ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108772024-11-09T02:56:03.049ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108782024-11-09T02:56:03.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108792024-11-09T02:56:03.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108802024-11-09T02:56:03.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108812024-11-09T02:56:03.055ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108822024-11-09T02:56:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108832024-11-09T02:56:03.057ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108842024-11-09T02:56:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108852024-11-09T02:56:03.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108862024-11-09T02:56:03.060ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108872024-11-09T02:56:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
108882024-11-09T02:56:03.061ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108892024-11-09T02:56:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108902024-11-09T02:56:03.064ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 51.060766ms iteration = 20 status = 0
108912024-11-09T02:56:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
108922024-11-09T02:56:03.064ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108932024-11-09T02:56:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108942024-11-09T02:56:03.074ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 61.324287ms iteration = 22 status = {"physical_disks_added":0}
108952024-11-09T02:56:03.076ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108962024-11-09T02:56:03.076ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.92087ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108972024-11-09T02:56:03.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
108982024-11-09T02:56:03.079ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.552736ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
108992024-11-09T02:56:03.082ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109002024-11-09T02:56:03.082ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109012024-11-09T02:56:03.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109022024-11-09T02:56:03.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109032024-11-09T02:56:03.094ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.119576ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
109042024-11-09T02:56:03.100ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
109052024-11-09T02:56:03.100ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109062024-11-09T02:56:03.101ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "81bc398c-1a94-4b38-b99d-96184c4bad33", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109072024-11-09T02:56:03.101ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109082024-11-09T02:56:03.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
109092024-11-09T02:56:03.103ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109102024-11-09T02:56:03.103ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
109112024-11-09T02:56:03.103ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109122024-11-09T02:56:03.103ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7726d5b4-da73-42ec-b973-1f025599eb2a", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109132024-11-09T02:56:03.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109142024-11-09T02:56:03.103ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eb13eeb-e02d-4f5d-adab-5491e0e406c1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109152024-11-09T02:56:03.103ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109162024-11-09T02:56:03.103ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109172024-11-09T02:56:03.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
109182024-11-09T02:56:03.106ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109192024-11-09T02:56:03.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109202024-11-09T02:56:03.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
109212024-11-09T02:56:03.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 98.449615ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
109222024-11-09T02:56:03.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109232024-11-09T02:56:03.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109242024-11-09T02:56:03.230ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109252024-11-09T02:56:03.230ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109262024-11-09T02:56:03.231ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2072e03-f7f5-4f8b-aedf-a844f442cb09", "content-length": "372", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109272024-11-09T02:56:03.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109282024-11-09T02:56:03.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109292024-11-09T02:56:03.242ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109302024-11-09T02:56:03.243ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "570efb9d-aac6-4c96-ace4-9bed00b084ad", "content-length": "1", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
109312024-11-09T02:56:03.245ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109322024-11-09T02:56:03.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109332024-11-09T02:56:03.248ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 234.763132ms iteration = 20 status = null
109342024-11-09T02:56:03.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109352024-11-09T02:56:03.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109362024-11-09T02:56:03.274ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109372024-11-09T02:56:03.276ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109382024-11-09T02:56:03.276ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109392024-11-09T02:56:03.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109402024-11-09T02:56:03.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109412024-11-09T02:56:03.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109422024-11-09T02:56:03.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109432024-11-09T02:56:03.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109442024-11-09T02:56:03.286ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
109452024-11-09T02:56:03.286ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109462024-11-09T02:56:03.287ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "738a89d7-22c2-4b20-9376-a2443c15cc83", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109472024-11-09T02:56:03.287ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109482024-11-09T02:56:03.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109492024-11-09T02:56:03.289ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109502024-11-09T02:56:03.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109512024-11-09T02:56:03.293ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109522024-11-09T02:56:03.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109532024-11-09T02:56:03.296ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109542024-11-09T02:56:03.296ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109552024-11-09T02:56:03.297ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e272ef5f-b917-4c9d-be70-48ee8bec9610", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109562024-11-09T02:56:03.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 285.125633ms iteration = 21 status = {}
109572024-11-09T02:56:03.338ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 325.060938ms iteration = 20 status = {}
109582024-11-09T02:56:03.361ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109592024-11-09T02:56:03.362ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a838d22-9303-4461-9c2d-e7a4526947e2", "content-length": "691", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109602024-11-09T02:56:03.362ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
109612024-11-09T02:56:03.362ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
109622024-11-09T02:56:03.362ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
109632024-11-09T02:56:03.363ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 350.140516ms iteration = 20 status = {}
109642024-11-09T02:56:03.417ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109652024-11-09T02:56:03.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109662024-11-09T02:56:03.420ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
109672024-11-09T02:56:03.420ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109682024-11-09T02:56:03.420ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109692024-11-09T02:56:03.429ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109702024-11-09T02:56:03.430ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c264c0ec-c564-401a-866b-df2d8bb2ae0e", "content-length": "134", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
109712024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109722024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
109732024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109742024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109752024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109762024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109772024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109782024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109792024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109802024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109812024-11-09T02:56:03.430ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
109822024-11-09T02:56:03.430ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109832024-11-09T02:56:03.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109842024-11-09T02:56:03.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
109852024-11-09T02:56:03.432ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4fc05da1-6022-4ab4-968f-c97a2375c429", "content-length": "2", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
109862024-11-09T02:56:03.432ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
109872024-11-09T02:56:03.433ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "015bda4f-1f46-4766-a26c-df7f0680eac2", "content-length": "52", "date": "Sat, 09 Nov 2024 02:56:02 GMT"} })
109882024-11-09T02:56:03.433ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
109892024-11-09T02:56:03.433ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
109902024-11-09T02:56:03.542ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "45662d6d-2eeb-486a-a40e-d96bd7a0f3d6", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109912024-11-09T02:56:03.543ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
109922024-11-09T02:56:03.543ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
109932024-11-09T02:56:03.543ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "43211651-9349-4a1a-a442-bcf352106809", "content-length": "682", "date": "Sat, 09 Nov 2024 02:56:03 GMT"} })
109942024-11-09T02:56:03.543ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109952024-11-09T02:56:03.544ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109962024-11-09T02:56:03.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109972024-11-09T02:56:03.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109982024-11-09T02:56:03.549ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109992024-11-09T02:56:03.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110002024-11-09T02:56:03.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110012024-11-09T02:56:03.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110022024-11-09T02:56:03.559ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 545.874811ms iteration = 20 status = {}
110032024-11-09T02:56:13.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
110042024-11-09T02:56:13.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110052024-11-09T02:56:13.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
110062024-11-09T02:56:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110072024-11-09T02:56:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110082024-11-09T02:56:13.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110092024-11-09T02:56:13.045ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110102024-11-09T02:56:13.045ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110112024-11-09T02:56:13.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110122024-11-09T02:56:13.051ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110132024-11-09T02:56:13.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110142024-11-09T02:56:13.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110152024-11-09T02:56:13.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110162024-11-09T02:56:13.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110172024-11-09T02:56:13.055ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110182024-11-09T02:56:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
110192024-11-09T02:56:13.058ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110202024-11-09T02:56:13.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110212024-11-09T02:56:13.067ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
110222024-11-09T02:56:13.067ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.768032ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
110232024-11-09T02:56:13.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.679903ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110242024-11-09T02:56:15.150ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1513 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 6159b820-3fdb-4d15-b271-0d62c49aa73a response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
110252024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
110262024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110272024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
110282024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110292024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110302024-11-09T02:56:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110312024-11-09T02:56:23.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110322024-11-09T02:56:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110332024-11-09T02:56:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110342024-11-09T02:56:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110352024-11-09T02:56:23.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110362024-11-09T02:56:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110372024-11-09T02:56:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110382024-11-09T02:56:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
110392024-11-09T02:56:23.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110402024-11-09T02:56:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110412024-11-09T02:56:23.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
110422024-11-09T02:56:23.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.959144ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
110432024-11-09T02:56:23.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110442024-11-09T02:56:23.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110452024-11-09T02:56:23.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.074091ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110462024-11-09T02:56:30.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1477 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = a2e8a38e-7054-4af4-a68e-1d6c4e856703 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
110472024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
110482024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
110492024-11-09T02:56:33.013ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
110502024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
110512024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 19.07\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
110522024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
110532024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
110542024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
110552024-11-09T02:56:33.013ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
110562024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
110572024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110582024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
110592024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
110602024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
110612024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
110622024-11-09T02:56:33.013ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110632024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
110642024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110652024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
110662024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
110672024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
110682024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
110692024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110702024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
110712024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
110722024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
110732024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
110742024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
110752024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
110762024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
110772024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
110782024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
110792024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
110802024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
110812024-11-09T02:56:33.013ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110822024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110832024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
110842024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110852024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110862024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
110872024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110882024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110892024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110902024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110912024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
110922024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
110932024-11-09T02:56:33.013ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:46:33.013357299 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110942024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110952024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
110962024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
110972024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
110982024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
110992024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
111002024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111012024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
111022024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
111032024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
111042024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.59\u{b5}s iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
111052024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 8.1\u{b5}s iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
111062024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
111072024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
111082024-11-09T02:56:33.013ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
111092024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
111102024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
111112024-11-09T02:56:33.013ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
111122024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.78\u{b5}s iteration = 21 status = {"errors":[],"records_set_to_done":[]}
111132024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
111142024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
111152024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
111162024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.631\u{b5}s iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
111172024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111182024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111192024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111202024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111212024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111222024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111232024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111242024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111252024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111262024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111272024-11-09T02:56:33.013ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 350512092 } })
111282024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111292024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111302024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111312024-11-09T02:56:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111322024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
111332024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111342024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
111352024-11-09T02:56:33.014ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
111362024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111372024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111382024-11-09T02:56:33.014ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 350612104 } })
111392024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111402024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111412024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
111422024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
111432024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.151684ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
111442024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
111452024-11-09T02:56:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.388639ms iteration = 12 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
111462024-11-09T02:56:33.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111472024-11-09T02:56:33.016ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111482024-11-09T02:56:33.016ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111492024-11-09T02:56:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111502024-11-09T02:56:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111512024-11-09T02:56:33.017ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.989432ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111522024-11-09T02:56:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
111532024-11-09T02:56:33.018ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111542024-11-09T02:56:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111552024-11-09T02:56:33.020ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111562024-11-09T02:56:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111572024-11-09T02:56:33.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111582024-11-09T02:56:33.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111592024-11-09T02:56:33.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111602024-11-09T02:56:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111612024-11-09T02:56:33.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 358733382 } })
111622024-11-09T02:56:33.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
111632024-11-09T02:56:33.023ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111642024-11-09T02:56:33.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111652024-11-09T02:56:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111662024-11-09T02:56:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
111672024-11-09T02:56:33.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111682024-11-09T02:56:33.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111692024-11-09T02:56:33.026ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:46:33.013357299 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
111702024-11-09T02:56:33.026ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.232413ms iteration = 11 status = {"expiration":"2024-11-09T02:46:33.013357299Z","pruned":[]}
111712024-11-09T02:56:33.028ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111722024-11-09T02:56:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111732024-11-09T02:56:33.030ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 16.760437ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
111742024-11-09T02:56:33.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111752024-11-09T02:56:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111762024-11-09T02:56:33.034ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111772024-11-09T02:56:33.034ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 371551527 } })
111782024-11-09T02:56:33.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
111792024-11-09T02:56:33.035ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111802024-11-09T02:56:33.035ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
111812024-11-09T02:56:33.035ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 22.495494ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
111822024-11-09T02:56:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111832024-11-09T02:56:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111842024-11-09T02:56:33.036ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111852024-11-09T02:56:33.036ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111862024-11-09T02:56:33.038ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 24.939776ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
111872024-11-09T02:56:33.038ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111882024-11-09T02:56:33.040ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111892024-11-09T02:56:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111902024-11-09T02:56:33.041ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111912024-11-09T02:56:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
111922024-11-09T02:56:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111932024-11-09T02:56:33.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111942024-11-09T02:56:33.050ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 386984046 } })
111952024-11-09T02:56:33.050ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
111962024-11-09T02:56:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
111972024-11-09T02:56:33.052ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111982024-11-09T02:56:33.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111992024-11-09T02:56:33.054ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112002024-11-09T02:56:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112012024-11-09T02:56:33.057ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112022024-11-09T02:56:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
112032024-11-09T02:56:33.061ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112042024-11-09T02:56:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112052024-11-09T02:56:33.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112062024-11-09T02:56:33.064ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112072024-11-09T02:56:33.065ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112082024-11-09T02:56:33.065ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112092024-11-09T02:56:33.065ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112102024-11-09T02:56:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112112024-11-09T02:56:33.067ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112122024-11-09T02:56:33.067ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112132024-11-09T02:56:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112142024-11-09T02:56:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
112152024-11-09T02:56:33.068ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112162024-11-09T02:56:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112172024-11-09T02:56:33.069ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112182024-11-09T02:56:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112192024-11-09T02:56:33.070ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112202024-11-09T02:56:33.071ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112212024-11-09T02:56:33.071ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112222024-11-09T02:56:33.071ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
112232024-11-09T02:56:33.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112242024-11-09T02:56:33.072ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112252024-11-09T02:56:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112262024-11-09T02:56:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112272024-11-09T02:56:33.073ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
112282024-11-09T02:56:33.073ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 59.813156ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
112292024-11-09T02:56:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112302024-11-09T02:56:33.074ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112312024-11-09T02:56:33.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
112322024-11-09T02:56:33.074ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
112332024-11-09T02:56:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112342024-11-09T02:56:33.075ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
112352024-11-09T02:56:33.077ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112362024-11-09T02:56:33.079ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(bb5f090b-6d54-48ce-bdc0-b8acfa4298d5, 0), (aee3d201-e34c-48bf-ac54-35a88124914c, 0), (ae7eda3c-463c-4531-b460-1654db48aec5, 0), (49c72ac0-6fc5-47c7-a85f-9108666236bb, 0)] collection_id = bb5f090b-6d54-48ce-bdc0-b8acfa4298d5
112372024-11-09T02:56:33.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112382024-11-09T02:56:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112392024-11-09T02:56:33.080ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112402024-11-09T02:56:33.080ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
112412024-11-09T02:56:33.080ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112422024-11-09T02:56:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112432024-11-09T02:56:33.082ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
112442024-11-09T02:56:33.082ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
112452024-11-09T02:56:33.082ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
112462024-11-09T02:56:33.082ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
112472024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 41efb3ef-6a49-4032-ae94-b8cab2ca46ad
112482024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 49944f85-420b-407d-bbdd-5320085c2dde
112492024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 83a4ddad-2311-4e2c-9165-2b4c16eaaa23
112502024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112512024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112522024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112532024-11-09T02:56:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112542024-11-09T02:56:33.083ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112552024-11-09T02:56:33.085ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 72.07409ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
112562024-11-09T02:56:33.086ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
112572024-11-09T02:56:33.086ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
112582024-11-09T02:56:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
112592024-11-09T02:56:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112602024-11-09T02:56:33.089ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112612024-11-09T02:56:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112622024-11-09T02:56:33.090ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
112632024-11-09T02:56:33.090ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 77.114884ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
112642024-11-09T02:56:33.092ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112652024-11-09T02:56:33.092ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112662024-11-09T02:56:33.092ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112672024-11-09T02:56:33.092ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112682024-11-09T02:56:33.092ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112692024-11-09T02:56:33.094ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
112702024-11-09T02:56:33.094ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
112712024-11-09T02:56:33.094ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 80.520444ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
112722024-11-09T02:56:33.096ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
112732024-11-09T02:56:33.096ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
112742024-11-09T02:56:33.096ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.339583ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
112752024-11-09T02:56:33.097ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
112762024-11-09T02:56:33.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
112772024-11-09T02:56:33.103ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 90.516141ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
112782024-11-09T02:56:33.108ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112792024-11-09T02:56:33.108ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
112802024-11-09T02:56:33.108ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.529234ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
112812024-11-09T02:56:33.114ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
112822024-11-09T02:56:33.114ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
112832024-11-09T02:56:33.114ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
112842024-11-09T02:56:33.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
112852024-11-09T02:56:33.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
112862024-11-09T02:56:33.203ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
112872024-11-09T02:56:33.204ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
112882024-11-09T02:56:33.204ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112892024-11-09T02:56:33.205ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb1d31c4-fc97-4601-865b-0f28598da96b", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
112902024-11-09T02:56:33.205ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112912024-11-09T02:56:33.207ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
112922024-11-09T02:56:33.248ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
112932024-11-09T02:56:33.280ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
112942024-11-09T02:56:33.280ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
112952024-11-09T02:56:33.281ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f956b8eb-9bcd-419e-b55a-9c22f0c8399c", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
112962024-11-09T02:56:33.281ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
112972024-11-09T02:56:33.282ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
112982024-11-09T02:56:33.304ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
112992024-11-09T02:56:33.304ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
113002024-11-09T02:56:33.304ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c060b4a-ef2b-4542-85e4-6a0a8f09d4bf", "content-length": "26", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
113012024-11-09T02:56:33.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
113022024-11-09T02:56:33.307ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
113032024-11-09T02:56:33.338ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
113042024-11-09T02:56:33.338ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7256fae6-e16d-47a7-95e9-2603ce6161ee", "content-length": "691", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
113052024-11-09T02:56:33.338ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
113062024-11-09T02:56:33.338ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
113072024-11-09T02:56:33.338ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
113082024-11-09T02:56:33.341ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 327.970898ms iteration = 21 status = {}
113092024-11-09T02:56:33.341ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113102024-11-09T02:56:33.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113112024-11-09T02:56:33.342ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113122024-11-09T02:56:33.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113132024-11-09T02:56:33.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113142024-11-09T02:56:33.343ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113152024-11-09T02:56:33.344ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113162024-11-09T02:56:33.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113172024-11-09T02:56:33.345ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113182024-11-09T02:56:33.347ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113192024-11-09T02:56:33.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113202024-11-09T02:56:33.348ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113212024-11-09T02:56:33.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113222024-11-09T02:56:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
113232024-11-09T02:56:33.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113242024-11-09T02:56:33.352ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113252024-11-09T02:56:33.354ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 341.099899ms iteration = 21 status = 0
113262024-11-09T02:56:33.372ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = bb5f090b-6d54-48ce-bdc0-b8acfa4298d5 file = nexus/db-queries/src/db/datastore/inventory.rs:1446 ncabooses = 0 nclickhouse_keeper_membership = 0 ncollections = 0 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 0 nrots = 0 nsled_agent_zones = 0 nsled_agents = 0 nsps = 0 nzones = 0 nzpools = 0
113272024-11-09T02:56:33.372ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
113282024-11-09T02:56:33.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
113292024-11-09T02:56:33.385ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(aee3d201-e34c-48bf-ac54-35a88124914c, 0), (ae7eda3c-463c-4531-b460-1654db48aec5, 0), (49c72ac0-6fc5-47c7-a85f-9108666236bb, 0)]
113302024-11-09T02:56:33.385ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1496, tv_nsec: 722139232 } })
113312024-11-09T02:56:33.385ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113322024-11-09T02:56:33.388ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
113332024-11-09T02:56:33.388ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113342024-11-09T02:56:33.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113352024-11-09T02:56:33.389ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113362024-11-09T02:56:33.391ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113372024-11-09T02:56:33.394ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113382024-11-09T02:56:33.394ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113392024-11-09T02:56:33.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113402024-11-09T02:56:33.395ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113412024-11-09T02:56:33.396ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113422024-11-09T02:56:33.396ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113432024-11-09T02:56:33.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113442024-11-09T02:56:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113452024-11-09T02:56:33.399ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113462024-11-09T02:56:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113472024-11-09T02:56:33.401ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113482024-11-09T02:56:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113492024-11-09T02:56:33.403ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113502024-11-09T02:56:33.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113512024-11-09T02:56:33.420ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 406.874538ms iteration = 21 status = {}
113522024-11-09T02:56:33.422ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
113532024-11-09T02:56:33.427ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
113542024-11-09T02:56:33.427ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "328270db-7220-40ea-bd3d-bd294e9b327b", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113552024-11-09T02:56:33.427ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113562024-11-09T02:56:33.430ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "ae6e7a73-e01f-4950-82b9-6ea37636b076", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113572024-11-09T02:56:33.430ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113582024-11-09T02:56:33.432ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
113592024-11-09T02:56:33.432ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 419.424447ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
113602024-11-09T02:56:33.433ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
113612024-11-09T02:56:33.433ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
113622024-11-09T02:56:33.433ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113632024-11-09T02:56:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113642024-11-09T02:56:33.433ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113652024-11-09T02:56:33.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113662024-11-09T02:56:33.435ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113672024-11-09T02:56:33.435ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
113682024-11-09T02:56:33.435ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113692024-11-09T02:56:33.435ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113702024-11-09T02:56:33.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113712024-11-09T02:56:33.437ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113722024-11-09T02:56:33.437ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113732024-11-09T02:56:33.437ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113742024-11-09T02:56:33.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113752024-11-09T02:56:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113762024-11-09T02:56:33.443ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113772024-11-09T02:56:33.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113782024-11-09T02:56:33.448ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113792024-11-09T02:56:33.453ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113802024-11-09T02:56:33.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113812024-11-09T02:56:33.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113822024-11-09T02:56:33.480ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
113832024-11-09T02:56:33.480ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 467.107193ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
113842024-11-09T02:56:33.489ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113852024-11-09T02:56:33.493ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113862024-11-09T02:56:33.493ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113872024-11-09T02:56:33.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113882024-11-09T02:56:33.500ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 486.701468ms iteration = 23 status = {"physical_disks_added":0}
113892024-11-09T02:56:33.524ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
113902024-11-09T02:56:33.525ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc5e0955-b42b-4287-a4e3-e25e298b2ce8", "content-length": "1", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
113912024-11-09T02:56:33.527ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
113922024-11-09T02:56:33.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
113932024-11-09T02:56:33.553ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
113942024-11-09T02:56:33.553ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83ab7c35-0071-406c-b6e5-9afcb1502e5d", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
113952024-11-09T02:56:33.553ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
113962024-11-09T02:56:33.556ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "f3a4e394-0246-494d-b1e4-cc1a4f92f307", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
113972024-11-09T02:56:33.556ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
113982024-11-09T02:56:33.557ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "690ef9a3-1374-46b3-9ebc-1406c438abbb", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
113992024-11-09T02:56:33.557ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114002024-11-09T02:56:33.559ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
114012024-11-09T02:56:33.559ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 546.75481ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
114022024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
114032024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
114042024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
114052024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "23014dda-a8bc-4f75-8e8f-88282307ff1f", "content-length": "476", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114062024-11-09T02:56:33.571ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
114072024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "85288a15-87e6-482a-bd99-6a23af55ad01", "content-length": "734", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114082024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
114092024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8de5da5-6004-4f05-9e0c-5846ee42204a", "content-length": "111", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114102024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
114112024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "16408e4c-e464-449c-8c99-6794722ec7d7", "content-length": "111", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114122024-11-09T02:56:33.572ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
114132024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "609c1d24-2f80-4016-8078-c9eb73dee0e0", "content-length": "167", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114142024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
114152024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "02750fb7-7a57-4ccb-b918-1f4a34aa52fe", "content-length": "167", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114162024-11-09T02:56:33.573ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
114172024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a5c7b9f4-201b-4e80-851c-93f58eed41cf", "content-length": "175", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114182024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
114192024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c090c1c-f064-4795-b763-95731c2fbefc", "content-length": "175", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114202024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
114212024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad8035a1-1965-450c-b596-094f67f08229", "content-length": "702", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114222024-11-09T02:56:33.574ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114232024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "149f0e25-94b2-48b7-9410-ff3c7691de09", "content-length": "727", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114242024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114252024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f7528e4e-34de-4cf0-874e-7ca6dc7e6214", "content-length": "729", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114262024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
114272024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "52c26c3f-f92c-4106-9553-b91d4d178919", "content-length": "728", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114282024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
114292024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "93098896-eead-460f-a820-d1e9889071fa", "content-length": "722", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114302024-11-09T02:56:33.575ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
114312024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7c854b2-ebde-46bd-9674-c378eede1c6c", "content-length": "109", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114322024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
114332024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfd6fe12-f36a-4392-beda-31f171ac0e50", "content-length": "109", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114342024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
114352024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3756c5c-b645-4574-8fac-752e6234d659", "content-length": "169", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114362024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
114372024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d6b3390-bbb1-4d2e-9aba-a154d1742798", "content-length": "169", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114382024-11-09T02:56:33.576ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
114392024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "2398d9af-b887-4b21-a21b-714fe3aca699", "content-length": "178", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114402024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
114412024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "0fa8bcd4-0d4f-448e-9837-e29e8455cd5d", "content-length": "178", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114422024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
114432024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c301b2a-1a6b-4bbe-8a7d-8a5054e8fc46", "content-length": "702", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114442024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114452024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "6283451c-92b7-46f9-9d45-45ba67716995", "content-length": "727", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114462024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114472024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f05067f7-87cc-4979-a39f-e7d2500b200d", "content-length": "729", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114482024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
114492024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0636972c-88aa-4a2b-9804-a3d9e7393ca3", "content-length": "728", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114502024-11-09T02:56:33.577ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114512024-11-09T02:56:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114522024-11-09T02:56:33.579ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114532024-11-09T02:56:33.579ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114542024-11-09T02:56:33.580ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "db17296c-1f98-4c6b-89ed-cd768a2a9ebd", "content-length": "372", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114552024-11-09T02:56:33.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
114562024-11-09T02:56:33.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
114572024-11-09T02:56:33.586ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
114582024-11-09T02:56:33.586ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
114592024-11-09T02:56:33.586ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
114602024-11-09T02:56:33.586ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 573.640575ms iteration = 12 status = {"generation":2}
114612024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
114622024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
114632024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
114642024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 573.848819ms iteration = 12 status = {"generation":1}
114652024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114662024-11-09T02:56:33.587ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114672024-11-09T02:56:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114682024-11-09T02:56:33.588ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 575.003013ms iteration = 21 status = null
114692024-11-09T02:56:33.592ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
114702024-11-09T02:56:33.592ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
114712024-11-09T02:56:33.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
114722024-11-09T02:56:33.594ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114732024-11-09T02:56:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114742024-11-09T02:56:33.596ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114752024-11-09T02:56:33.596ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114762024-11-09T02:56:33.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114772024-11-09T02:56:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114782024-11-09T02:56:33.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114792024-11-09T02:56:33.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114802024-11-09T02:56:33.614ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
114812024-11-09T02:56:33.614ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114822024-11-09T02:56:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114832024-11-09T02:56:33.622ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114842024-11-09T02:56:33.622ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
114852024-11-09T02:56:33.623ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f257eb53-05e7-46d2-84a2-96eb426b2221", "content-length": "134", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
114862024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
114872024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
114882024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
114892024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
114902024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114912024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114922024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114932024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114942024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
114952024-11-09T02:56:33.623ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
114962024-11-09T02:56:33.624ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
114972024-11-09T02:56:33.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
114982024-11-09T02:56:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
114992024-11-09T02:56:33.624ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115002024-11-09T02:56:33.624ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115012024-11-09T02:56:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115022024-11-09T02:56:33.626ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
115032024-11-09T02:56:33.626ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "23c10aa0-5df9-4f43-b127-e39a4d421ef1", "content-length": "2", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115042024-11-09T02:56:33.626ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
115052024-11-09T02:56:33.626ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0e675ed-6c19-485a-b7de-7bb74cdb0b97", "content-length": "52", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115062024-11-09T02:56:33.626ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
115072024-11-09T02:56:33.626ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
115082024-11-09T02:56:33.633ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115092024-11-09T02:56:33.633ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
115102024-11-09T02:56:33.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115112024-11-09T02:56:33.633ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115122024-11-09T02:56:33.634ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115132024-11-09T02:56:33.635ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115142024-11-09T02:56:33.636ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115152024-11-09T02:56:33.640ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
115162024-11-09T02:56:33.640ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115172024-11-09T02:56:33.640ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115182024-11-09T02:56:33.641ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115192024-11-09T02:56:33.642ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115202024-11-09T02:56:33.643ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115212024-11-09T02:56:33.644ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115222024-11-09T02:56:33.646ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115232024-11-09T02:56:33.646ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115242024-11-09T02:56:33.648ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115252024-11-09T02:56:33.648ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115262024-11-09T02:56:33.649ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115272024-11-09T02:56:33.649ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115282024-11-09T02:56:33.650ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115292024-11-09T02:56:33.651ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115302024-11-09T02:56:33.652ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115312024-11-09T02:56:33.658ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
115322024-11-09T02:56:33.658ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115332024-11-09T02:56:33.658ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115342024-11-09T02:56:33.695ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115352024-11-09T02:56:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115362024-11-09T02:56:33.697ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115372024-11-09T02:56:33.697ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115382024-11-09T02:56:33.699ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115392024-11-09T02:56:33.703ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
115402024-11-09T02:56:33.703ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115412024-11-09T02:56:33.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115422024-11-09T02:56:33.708ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115432024-11-09T02:56:33.708ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115442024-11-09T02:56:33.710ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115452024-11-09T02:56:33.710ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115462024-11-09T02:56:33.720ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
115472024-11-09T02:56:33.720ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
115482024-11-09T02:56:33.723ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115492024-11-09T02:56:33.723ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115502024-11-09T02:56:33.726ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115512024-11-09T02:56:33.726ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115522024-11-09T02:56:33.729ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115532024-11-09T02:56:33.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115542024-11-09T02:56:33.747ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d3799add-b2bf-4965-b7fa-014c41274a34", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115552024-11-09T02:56:33.747ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
115562024-11-09T02:56:33.747ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
115572024-11-09T02:56:33.749ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "cf01f1f0-b51a-481a-b8f7-3b1099e06b42", "content-length": "682", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115582024-11-09T02:56:33.749ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115592024-11-09T02:56:33.749ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115602024-11-09T02:56:33.753ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115612024-11-09T02:56:33.754ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115622024-11-09T02:56:33.756ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "6000dd2a-f1d1-4c13-9919-99bc1688e2d3", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115632024-11-09T02:56:33.756ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115642024-11-09T02:56:33.756ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115652024-11-09T02:56:33.757ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115662024-11-09T02:56:33.757ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115672024-11-09T02:56:33.759ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115682024-11-09T02:56:33.759ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115692024-11-09T02:56:33.759ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115702024-11-09T02:56:33.760ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
115712024-11-09T02:56:33.763ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115722024-11-09T02:56:33.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115732024-11-09T02:56:33.764ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115742024-11-09T02:56:33.764ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115752024-11-09T02:56:33.765ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115762024-11-09T02:56:33.765ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115772024-11-09T02:56:33.766ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115782024-11-09T02:56:33.766ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ec2eccd7-17c5-4a65-820c-fafca9d896b7", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
115792024-11-09T02:56:33.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115802024-11-09T02:56:33.766ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 753.440091ms iteration = 21 status = {}
115812024-11-09T02:56:33.768ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 755.266258ms iteration = 22 status = {}
115822024-11-09T02:56:33.798ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115832024-11-09T02:56:33.801ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
115842024-11-09T02:56:33.801ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115852024-11-09T02:56:33.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115862024-11-09T02:56:33.803ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115872024-11-09T02:56:33.803ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115882024-11-09T02:56:33.805ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115892024-11-09T02:56:33.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115902024-11-09T02:56:33.833ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115912024-11-09T02:56:33.837ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
115922024-11-09T02:56:33.837ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115932024-11-09T02:56:33.837ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115942024-11-09T02:56:33.844ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
115952024-11-09T02:56:33.844ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115962024-11-09T02:56:33.845ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115972024-11-09T02:56:33.846ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115982024-11-09T02:56:33.848ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
115992024-11-09T02:56:33.848ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116002024-11-09T02:56:33.848ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116012024-11-09T02:56:33.850ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
116022024-11-09T02:56:33.850ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: aa72dcff-155a-44f9-a2e7-012afe411f7a, kind: Service { id: 5cab3305-2cf8-4205-93bd-c0a5ec70688d }, name: Name("external-dns-5cab3305-2cf8-4205-93bd-c0a5ec70688d"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 185, 251])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: e09fd754-5a2d-4ad5-af87-f65f4fe294cc, kind: Service { id: e2d2fc82-684b-4404-ae54-ce48e33d41e3 }, name: Name("external-dns-e2d2fc82-684b-4404-ae54-ce48e33d41e3"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 189, 54])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 6605325d-9219-4c52-a246-627be8937804, kind: Service { id: c3da9028-2f6b-4199-8d06-98c01f75b9bf }, name: Name("nexus-c3da9028-2f6b-4199-8d06-98c01f75b9bf"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 137, 51])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cd9c7f98-ca50-485a-b02a-a17a60c7c197, kind: Service { id: 0339f029-6c8d-4b23-83cc-6885965f777d }, name: Name("nexus-0339f029-6c8d-4b23-83cc-6885965f777d"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 179, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: f30f824b-79e3-4862-bff7-ff49b8d24fe2, kind: Service { id: ea2b5fec-1bb6-4488-9cf9-d60d9b99619b }, name: Name("nexus-ea2b5fec-1bb6-4488-9cf9-d60d9b99619b"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 146, 126])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
116032024-11-09T02:56:33.850ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
116042024-11-09T02:56:33.905ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: f032ba4a-ac68-41c0-a068-00d3371df648, time_created: 2024-11-09T02:46:59.078381Z, time_modified: 2024-11-09T02:46:59.078381Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, is_scrimlet: true, serial_number: "buskin", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
116052024-11-09T02:56:33.905ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
116062024-11-09T02:56:33.905ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116072024-11-09T02:56:33.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116082024-11-09T02:56:33.907ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
116092024-11-09T02:56:33.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
116102024-11-09T02:56:33.909ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116112024-11-09T02:56:33.912ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
116122024-11-09T02:56:33.942ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
116132024-11-09T02:56:34.009ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "182d0bfa-c433-42b7-a910-75ed5fdb6ba2", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
116142024-11-09T02:56:34.010ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
116152024-11-09T02:56:34.010ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 997.694448ms
116162024-11-09T02:56:34.010ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 997.703888ms iteration = 3 status = {}
116172024-11-09T02:56:34.012ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "a2f8c0ef-b107-40dd-b172-a1770102958f", "content-length": "29193", "date": "Sat, 09 Nov 2024 02:56:33 GMT"} })
116182024-11-09T02:56:34.015ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
116192024-11-09T02:56:34.017ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116202024-11-09T02:56:34.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116212024-11-09T02:56:34.018ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116222024-11-09T02:56:34.020ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
116232024-11-09T02:56:34.020ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116242024-11-09T02:56:34.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116252024-11-09T02:56:34.189ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 4ea7b1f9-e3d7-4759-936f-0a40eab4e059 file = nexus/db-queries/src/db/datastore/inventory.rs:1000
116262024-11-09T02:56:34.189ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 4ea7b1f9-e3d7-4759-936f-0a40eab4e059 time_started = 2024-11-09 02:56:33.571412 UTC
116272024-11-09T02:56:34.189ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.176438433s iteration = 3 status = {"collection_id":"4ea7b1f9-e3d7-4759-936f-0a40eab4e059","time_done":"2024-11-09 02:56:34.015124 UTC","time_started":"2024-11-09 02:56:33.571412 UTC"}
116282024-11-09T02:56:34.189ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
116292024-11-09T02:56:34.189ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116302024-11-09T02:56:34.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116312024-11-09T02:56:34.217ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116322024-11-09T02:56:34.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116332024-11-09T02:56:34.219ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116342024-11-09T02:56:34.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116352024-11-09T02:56:34.220ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116362024-11-09T02:56:34.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116372024-11-09T02:56:34.222ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116382024-11-09T02:56:34.224ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116392024-11-09T02:56:34.224ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116402024-11-09T02:56:34.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116412024-11-09T02:56:34.321ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 131.416186ms iteration = 24 status = {"physical_disks_added":0}
116422024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
116432024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116442024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116452024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116462024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116472024-11-09T02:56:43.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116482024-11-09T02:56:43.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116492024-11-09T02:56:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116502024-11-09T02:56:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116512024-11-09T02:56:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116522024-11-09T02:56:43.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116532024-11-09T02:56:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116542024-11-09T02:56:43.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116552024-11-09T02:56:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
116562024-11-09T02:56:43.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116572024-11-09T02:56:43.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116582024-11-09T02:56:43.038ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
116592024-11-09T02:56:43.038ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.877474ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
116602024-11-09T02:56:43.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116612024-11-09T02:56:43.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116622024-11-09T02:56:43.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 62.060842ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116632024-11-09T02:56:45.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1599 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 94a5bca4-75a9-4748-8126-648d5a3094b6 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
116642024-11-09T02:56:46.882ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64827
116652024-11-09T02:56:46.882ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64827 req_id = 8e36ecaf-794b-4801-aa90-b76703e3f484 roles = RoleSet { roles: {} } uri = /metrics/producers
116662024-11-09T02:56:46.883ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64827 req_id = 8e36ecaf-794b-4801-aa90-b76703e3f484 resource = Database result = Ok(()) uri = /metrics/producers
116672024-11-09T02:56:46.916ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
116682024-11-09T02:56:46.916ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 33421 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64827 req_id = 8e36ecaf-794b-4801-aa90-b76703e3f484 response_code = 201 uri = /metrics/producers
116692024-11-09T02:56:48.586ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:64629
116702024-11-09T02:56:48.586ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64629 req_id = baa41c07-515b-43b4-8133-2c1db639ccf6 roles = RoleSet { roles: {} } uri = /metrics/producers
116712024-11-09T02:56:48.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64629 req_id = baa41c07-515b-43b4-8133-2c1db639ccf6 resource = Database result = Ok(()) uri = /metrics/producers
116722024-11-09T02:56:48.627ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
116732024-11-09T02:56:48.627ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 41770 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:64629 req_id = baa41c07-515b-43b4-8133-2c1db639ccf6 response_code = 201 uri = /metrics/producers
116742024-11-09T02:56:50.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a504c37f-9d2f-4b87-8497-f8f780bab11b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
116752024-11-09T02:56:50.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a504c37f-9d2f-4b87-8497-f8f780bab11b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
116762024-11-09T02:56:50.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2698 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = a504c37f-9d2f-4b87-8497-f8f780bab11b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
116772024-11-09T02:56:50.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = fefad882-ce32-4207-8ca9-b927bbce6e08 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
116782024-11-09T02:56:50.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = fefad882-ce32-4207-8ca9-b927bbce6e08 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
116792024-11-09T02:56:50.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2543 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = fefad882-ce32-4207-8ca9-b927bbce6e08 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
116802024-11-09T02:56:52.524ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:36847
116812024-11-09T02:56:52.524ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36847 req_id = cc1deb91-93f8-463b-b0a0-5a977cc80652 roles = RoleSet { roles: {} } uri = /metrics/producers
116822024-11-09T02:56:52.525ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36847 req_id = cc1deb91-93f8-463b-b0a0-5a977cc80652 resource = Database result = Ok(()) uri = /metrics/producers
116832024-11-09T02:56:52.562ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
116842024-11-09T02:56:52.562ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 38012 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:36847 req_id = cc1deb91-93f8-463b-b0a0-5a977cc80652 response_code = 201 uri = /metrics/producers
116852024-11-09T02:56:52.789ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53425
116862024-11-09T02:56:52.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53425 req_id = 63bbba3b-9fa8-4d06-a8ae-c3ad267eb313 roles = RoleSet { roles: {} } uri = /metrics/producers
116872024-11-09T02:56:52.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53425 req_id = 63bbba3b-9fa8-4d06-a8ae-c3ad267eb313 resource = Database result = Ok(()) uri = /metrics/producers
116882024-11-09T02:56:52.796ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
116892024-11-09T02:56:52.797ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 7457 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53425 req_id = 63bbba3b-9fa8-4d06-a8ae-c3ad267eb313 response_code = 201 uri = /metrics/producers
116902024-11-09T02:56:53.012ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
116912024-11-09T02:56:53.012ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
116922024-11-09T02:56:53.012ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116932024-11-09T02:56:53.012ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116942024-11-09T02:56:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116952024-11-09T02:56:53.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116962024-11-09T02:56:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116972024-11-09T02:56:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116982024-11-09T02:56:53.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116992024-11-09T02:56:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117002024-11-09T02:56:53.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117012024-11-09T02:56:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117022024-11-09T02:56:53.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117032024-11-09T02:56:53.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
117042024-11-09T02:56:53.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117052024-11-09T02:56:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117062024-11-09T02:56:53.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
117072024-11-09T02:56:53.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.879653ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
117082024-11-09T02:56:53.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117092024-11-09T02:56:53.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117102024-11-09T02:56:53.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.589232ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117112024-11-09T02:56:57.964ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:55675
117122024-11-09T02:56:57.964ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55675 req_id = 0153b1c2-53a7-4150-839e-11f0359fba65 roles = RoleSet { roles: {} } uri = /metrics/producers
117132024-11-09T02:56:57.964ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55675 req_id = 0153b1c2-53a7-4150-839e-11f0359fba65 resource = Database result = Ok(()) uri = /metrics/producers
117142024-11-09T02:56:57.995ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
117152024-11-09T02:56:57.995ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31103 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:55675 req_id = 0153b1c2-53a7-4150-839e-11f0359fba65 response_code = 201 uri = /metrics/producers
117162024-11-09T02:57:00.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1123 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 939dc019-6d21-46a6-9f51-aac8333d084d response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
117172024-11-09T02:57:02.125ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:42558
117182024-11-09T02:57:02.125ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42558 req_id = 5b3f7922-62e6-4769-8132-7dc9e926c0c2 roles = RoleSet { roles: {} } uri = /metrics/producers
117192024-11-09T02:57:02.125ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42558 req_id = 5b3f7922-62e6-4769-8132-7dc9e926c0c2 resource = Database result = Ok(()) uri = /metrics/producers
117202024-11-09T02:57:02.169ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
117212024-11-09T02:57:02.169ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44293 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:42558 req_id = 5b3f7922-62e6-4769-8132-7dc9e926c0c2 response_code = 201 uri = /metrics/producers
117222024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
117232024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
117242024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117252024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117262024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
117272024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117282024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117292024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
117302024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117312024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
117322024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
117332024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117342024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117352024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
117362024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
117372024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117382024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117392024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
117402024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
117412024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117422024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117432024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
117442024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117452024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
117462024-11-09T02:57:03.013ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117472024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
117482024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117492024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117502024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117512024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117522024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117532024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117542024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117552024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117562024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117572024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117582024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117592024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117602024-11-09T02:57:03.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117612024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
117622024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
117632024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 12.49\u{b5}s iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
117642024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 9.071\u{b5}s iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
117652024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
117662024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
117672024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 3.96\u{b5}s iteration = 22 status = {"errors":[],"records_set_to_done":[]}
117682024-11-09T02:57:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 8.041\u{b5}s iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
117692024-11-09T02:57:03.016ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117702024-11-09T02:57:03.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117712024-11-09T02:57:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.483983ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117722024-11-09T02:57:03.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 354416233 } })
117732024-11-09T02:57:03.018ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
117742024-11-09T02:57:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117752024-11-09T02:57:03.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117762024-11-09T02:57:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117772024-11-09T02:57:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
117782024-11-09T02:57:03.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117792024-11-09T02:57:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117802024-11-09T02:57:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117812024-11-09T02:57:03.022ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117822024-11-09T02:57:03.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 358796023 } })
117832024-11-09T02:57:03.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
117842024-11-09T02:57:03.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117852024-11-09T02:57:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117862024-11-09T02:57:03.025ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117872024-11-09T02:57:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117882024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
117892024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117902024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
117912024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117922024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117932024-11-09T02:57:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117942024-11-09T02:57:03.029ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117952024-11-09T02:57:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117962024-11-09T02:57:03.029ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117972024-11-09T02:57:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117982024-11-09T02:57:03.030ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1526, tv_nsec: 367306869 } })
117992024-11-09T02:57:03.031ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
118002024-11-09T02:57:03.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118012024-11-09T02:57:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118022024-11-09T02:57:03.053ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
118032024-11-09T02:57:03.053ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
118042024-11-09T02:57:03.054ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118052024-11-09T02:57:03.056ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118062024-11-09T02:57:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118072024-11-09T02:57:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118082024-11-09T02:57:03.056ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118092024-11-09T02:57:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118102024-11-09T02:57:03.058ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118112024-11-09T02:57:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118122024-11-09T02:57:03.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118132024-11-09T02:57:03.061ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118142024-11-09T02:57:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118152024-11-09T02:57:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
118162024-11-09T02:57:03.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118172024-11-09T02:57:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118182024-11-09T02:57:03.066ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 52.835912ms iteration = 22 status = 0
118192024-11-09T02:57:03.071ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118202024-11-09T02:57:03.071ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118212024-11-09T02:57:03.071ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118222024-11-09T02:57:03.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118232024-11-09T02:57:03.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118242024-11-09T02:57:03.071ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118252024-11-09T02:57:03.073ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118262024-11-09T02:57:03.073ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118272024-11-09T02:57:03.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118282024-11-09T02:57:03.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118292024-11-09T02:57:03.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118302024-11-09T02:57:03.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118312024-11-09T02:57:03.079ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118322024-11-09T02:57:03.082ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
118332024-11-09T02:57:03.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118342024-11-09T02:57:03.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118352024-11-09T02:57:03.086ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
118362024-11-09T02:57:03.086ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118372024-11-09T02:57:03.086ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2c1ebff7-74dd-48d1-adde-54259e255e58", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
118382024-11-09T02:57:03.086ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118392024-11-09T02:57:03.088ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118402024-11-09T02:57:03.093ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 80.867471ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118412024-11-09T02:57:03.094ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
118422024-11-09T02:57:03.094ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.628167ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
118432024-11-09T02:57:03.095ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
118442024-11-09T02:57:03.095ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118452024-11-09T02:57:03.096ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fcee365a-d63b-4beb-a7e5-b5a4483a6f38", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
118462024-11-09T02:57:03.096ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118472024-11-09T02:57:03.098ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 85.235241ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118482024-11-09T02:57:03.098ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118492024-11-09T02:57:03.101ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118502024-11-09T02:57:03.101ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 88.598631ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118512024-11-09T02:57:03.104ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 91.626483ms iteration = 25 status = {"physical_disks_added":0}
118522024-11-09T02:57:03.105ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118532024-11-09T02:57:03.105ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118542024-11-09T02:57:03.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118552024-11-09T02:57:03.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118562024-11-09T02:57:03.117ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
118572024-11-09T02:57:03.117ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118582024-11-09T02:57:03.117ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f58b679e-d106-4b87-aa92-072bf6a2bb5b", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
118592024-11-09T02:57:03.117ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118602024-11-09T02:57:03.118ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
118612024-11-09T02:57:03.123ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118622024-11-09T02:57:03.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118632024-11-09T02:57:03.135ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118642024-11-09T02:57:03.135ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118652024-11-09T02:57:03.135ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 122.191335ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118662024-11-09T02:57:03.208ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 195.49608ms iteration = 22 status = {}
118672024-11-09T02:57:03.212ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118682024-11-09T02:57:03.212ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "59815f7c-73bb-44ba-954d-954e8a8a6a12", "content-length": "1", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
118692024-11-09T02:57:03.214ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118702024-11-09T02:57:03.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118712024-11-09T02:57:03.231ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118722024-11-09T02:57:03.231ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118732024-11-09T02:57:03.231ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c2a9ae3-e551-4148-93eb-800c89aa6da0", "content-length": "372", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
118742024-11-09T02:57:03.231ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118752024-11-09T02:57:03.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118762024-11-09T02:57:03.233ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 220.694321ms iteration = 22 status = null
118772024-11-09T02:57:03.253ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
118782024-11-09T02:57:03.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118792024-11-09T02:57:03.253ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
118802024-11-09T02:57:03.254ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "76c2f876-c924-480c-8074-9ccd2c946c72", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
118812024-11-09T02:57:03.254ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118822024-11-09T02:57:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118832024-11-09T02:57:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118842024-11-09T02:57:03.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118852024-11-09T02:57:03.256ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118862024-11-09T02:57:03.260ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118872024-11-09T02:57:03.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118882024-11-09T02:57:03.264ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
118892024-11-09T02:57:03.264ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
118902024-11-09T02:57:03.265ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "b818b190-3fec-463d-9acb-9431b6e8f688", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
118912024-11-09T02:57:03.267ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 253.890477ms iteration = 23 status = {}
118922024-11-09T02:57:03.292ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118932024-11-09T02:57:03.294ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
118942024-11-09T02:57:03.294ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118952024-11-09T02:57:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118962024-11-09T02:57:03.307ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118972024-11-09T02:57:03.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118982024-11-09T02:57:03.310ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
118992024-11-09T02:57:03.310ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119002024-11-09T02:57:03.310ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119012024-11-09T02:57:03.320ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119022024-11-09T02:57:03.320ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "07d5b85d-78d2-4b39-9b26-87a3c9e5f4aa", "content-length": "134", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
119032024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119042024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
119052024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119062024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119072024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119082024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119092024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119102024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119112024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119122024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119132024-11-09T02:57:03.321ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
119142024-11-09T02:57:03.321ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119152024-11-09T02:57:03.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119162024-11-09T02:57:03.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119172024-11-09T02:57:03.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3a29b7b-d3d3-4e7c-8851-495372f44eb9", "content-length": "2", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
119182024-11-09T02:57:03.324ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119192024-11-09T02:57:03.324ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "bc34b1a6-54ff-48f9-90a9-83460328e5f7", "content-length": "52", "date": "Sat, 09 Nov 2024 02:57:02 GMT"} })
119202024-11-09T02:57:03.324ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
119212024-11-09T02:57:03.324ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119222024-11-09T02:57:03.331ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119232024-11-09T02:57:03.333ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119242024-11-09T02:57:03.333ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119252024-11-09T02:57:03.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119262024-11-09T02:57:03.429ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119272024-11-09T02:57:03.452ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0e86c861-2042-424b-abe4-74b1bb04f6fa", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
119282024-11-09T02:57:03.452ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
119292024-11-09T02:57:03.452ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119302024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d776ca88-b68e-4970-bac2-ad6fe2c4fb15", "content-length": "682", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
119312024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119322024-11-09T02:57:03.453ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119332024-11-09T02:57:03.457ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119342024-11-09T02:57:03.457ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119352024-11-09T02:57:03.460ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5da640d5-93a6-4175-9998-52d2319fce51", "content-length": "691", "date": "Sat, 09 Nov 2024 02:57:03 GMT"} })
119362024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
119372024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
119382024-11-09T02:57:03.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
119392024-11-09T02:57:03.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119402024-11-09T02:57:03.461ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 448.473418ms iteration = 22 status = {}
119412024-11-09T02:57:03.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119422024-11-09T02:57:03.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119432024-11-09T02:57:03.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119442024-11-09T02:57:03.472ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 459.080676ms iteration = 22 status = {}
119452024-11-09T02:57:05.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f64eb1d6-75c5-49a3-a250-921703a33ea5 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
119462024-11-09T02:57:05.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f64eb1d6-75c5-49a3-a250-921703a33ea5 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
119472024-11-09T02:57:05.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3186 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f64eb1d6-75c5-49a3-a250-921703a33ea5 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
119482024-11-09T02:57:05.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7d16fac0-18ca-4a93-9c37-20ffa5fbda56 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
119492024-11-09T02:57:05.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7d16fac0-18ca-4a93-9c37-20ffa5fbda56 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
119502024-11-09T02:57:05.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2400 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7d16fac0-18ca-4a93-9c37-20ffa5fbda56 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
119512024-11-09T02:57:10.157ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
119522024-11-09T02:57:10.157ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
119532024-11-09T02:57:10.187ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
119542024-11-09T02:57:10.187ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:56882
119552024-11-09T02:57:10.187ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56882 req_id = 4684ef81-1ea4-4713-9605-517a9e143ab1 roles = RoleSet { roles: {} } uri = /metrics/producers
119562024-11-09T02:57:10.188ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56882 req_id = 4684ef81-1ea4-4713-9605-517a9e143ab1 resource = Database result = Ok(()) uri = /metrics/producers
119572024-11-09T02:57:10.219ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
119582024-11-09T02:57:10.219ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 31869 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:56882 req_id = 4684ef81-1ea4-4713-9605-517a9e143ab1 response_code = 201 uri = /metrics/producers
119592024-11-09T02:57:10.219ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "4684ef81-1ea4-4713-9605-517a9e143ab1", "content-length": "41", "date": "Sat, 09 Nov 2024 02:57:10 GMT"} })
119602024-11-09T02:57:10.220ZDEBGnexus (producer-registration-task): registered with nexus successfully
119612024-11-09T02:57:10.221ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
119622024-11-09T02:57:13.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 65 reason = Timeout
119632024-11-09T02:57:13.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119642024-11-09T02:57:13.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 65 reason = Timeout
119652024-11-09T02:57:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119662024-11-09T02:57:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119672024-11-09T02:57:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119682024-11-09T02:57:13.042ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119692024-11-09T02:57:13.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119702024-11-09T02:57:13.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119712024-11-09T02:57:13.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119722024-11-09T02:57:13.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119732024-11-09T02:57:13.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119742024-11-09T02:57:13.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119752024-11-09T02:57:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119762024-11-09T02:57:13.071ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.182612ms iteration = 65 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
119772024-11-09T02:57:13.075ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119782024-11-09T02:57:13.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
119792024-11-09T02:57:13.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119802024-11-09T02:57:13.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119812024-11-09T02:57:13.089ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
119822024-11-09T02:57:13.089ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 75.96199ms iteration = 65 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
119832024-11-09T02:57:15.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1262 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 1476025a-e80b-4ab8-ae93-218089ab5957 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
119842024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 66 reason = Timeout
119852024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119862024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 66 reason = Timeout
119872024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119882024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119892024-11-09T02:57:23.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119902024-11-09T02:57:23.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119912024-11-09T02:57:23.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
119922024-11-09T02:57:23.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
119932024-11-09T02:57:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
119942024-11-09T02:57:23.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119952024-11-09T02:57:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119962024-11-09T02:57:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
119972024-11-09T02:57:23.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
119982024-11-09T02:57:23.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119992024-11-09T02:57:23.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
120002024-11-09T02:57:23.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120012024-11-09T02:57:23.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120022024-11-09T02:57:23.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
120032024-11-09T02:57:23.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.875352ms iteration = 66 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
120042024-11-09T02:57:23.047ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.639806ms iteration = 66 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
120052024-11-09T02:57:30.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1038 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = e4b94370-228f-445c-a185-7d02fafeb881 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
120062024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 13 reason = Timeout
120072024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
120082024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
120092024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 13 reason = Timeout
120102024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
120112024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120122024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 23 reason = Timeout
120132024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 12 reason = Timeout
120142024-11-09T02:57:33.013ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
120152024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
120162024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
120172024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 23 reason = Timeout
120182024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 23 reason = Timeout
120192024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
120202024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
120212024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 13 reason = Timeout
120222024-11-09T02:57:33.013ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
120232024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 20.361\u{b5}s iteration = 13 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
120242024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 23 reason = Timeout
120252024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
120262024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 67 reason = Timeout
120272024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 12 reason = Timeout
120282024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
120292024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
120302024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 14 reason = Timeout
120312024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 23 reason = Timeout
120322024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 23 reason = Timeout
120332024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
120342024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
120352024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 12 reason = Timeout
120362024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 24 reason = Timeout
120372024-11-09T02:57:33.013ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:47:33.013529784 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
120382024-11-09T02:57:33.013ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
120392024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
120402024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
120412024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 13 reason = Timeout
120422024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 14 reason = Timeout
120432024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 23 reason = Timeout
120442024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
120452024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 13 reason = Timeout
120462024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
120472024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 23 reason = Timeout
120482024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
120492024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 26 reason = Timeout
120502024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
120512024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 23 reason = Timeout
120522024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
120532024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 67 reason = Timeout
120542024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
120552024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 13 reason = Timeout
120562024-11-09T02:57:33.013ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120572024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
120582024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
120592024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
120602024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
120612024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
120622024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
120632024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
120642024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
120652024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
120662024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 23 reason = Timeout
120672024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 12 reason = Timeout
120682024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
120692024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 12 reason = Timeout
120702024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
120712024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 23 reason = Timeout
120722024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.05\u{b5}s iteration = 23 status = {"errors":[],"garbage_collect_requested":[]}
120732024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
120742024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 23 reason = Timeout
120752024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.11\u{b5}s iteration = 23 status = {"errors":[],"records_set_to_done":[]}
120762024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 6.12\u{b5}s iteration = 23 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
120772024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 23 reason = Timeout
120782024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.15\u{b5}s iteration = 23 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
120792024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
120802024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
120812024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
120822024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
120832024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
120842024-11-09T02:57:33.014ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 350361959 } })
120852024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
120862024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
120872024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
120882024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
120892024-11-09T02:57:33.014ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 350537803 } })
120902024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
120912024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.163694ms iteration = 13 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
120922024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
120932024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
120942024-11-09T02:57:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.147183ms iteration = 13 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
120952024-11-09T02:57:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
120962024-11-09T02:57:33.016ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120972024-11-09T02:57:33.017ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
120982024-11-09T02:57:33.017ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.8969ms iteration = 23 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
120992024-11-09T02:57:33.017ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121002024-11-09T02:57:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121012024-11-09T02:57:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
121022024-11-09T02:57:33.019ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
121032024-11-09T02:57:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
121042024-11-09T02:57:33.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
121052024-11-09T02:57:33.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
121062024-11-09T02:57:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
121072024-11-09T02:57:33.024ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:47:33.013529784 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
121082024-11-09T02:57:33.024ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.055589ms iteration = 12 status = {"expiration":"2024-11-09T02:47:33.013529784Z","pruned":[]}
121092024-11-09T02:57:33.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 362115412 } })
121102024-11-09T02:57:33.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
121112024-11-09T02:57:33.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 363142903 } })
121122024-11-09T02:57:33.027ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 13.04955ms iteration = 12 status = {"errors":[],"found_port_ok":[]}
121132024-11-09T02:57:33.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
121142024-11-09T02:57:33.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121152024-11-09T02:57:33.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1556, tv_nsec: 365861109 } })
121162024-11-09T02:57:33.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
121172024-11-09T02:57:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121182024-11-09T02:57:33.067ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121192024-11-09T02:57:33.068ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
121202024-11-09T02:57:33.068ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
121212024-11-09T02:57:33.068ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
121222024-11-09T02:57:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
121232024-11-09T02:57:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
121242024-11-09T02:57:33.069ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
121252024-11-09T02:57:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
121262024-11-09T02:57:33.072ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121272024-11-09T02:57:33.072ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
121282024-11-09T02:57:33.072ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
121292024-11-09T02:57:33.072ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
121302024-11-09T02:57:33.072ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 58.53625ms iteration = 12 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
121312024-11-09T02:57:33.072ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
121322024-11-09T02:57:33.073ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121332024-11-09T02:57:33.073ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
121342024-11-09T02:57:33.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 60.044461ms iteration = 23 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
121352024-11-09T02:57:33.074ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
121362024-11-09T02:57:33.074ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121372024-11-09T02:57:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121382024-11-09T02:57:33.074ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121392024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
121402024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
121412024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121422024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121432024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
121442024-11-09T02:57:33.076ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121452024-11-09T02:57:33.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121462024-11-09T02:57:33.077ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
121472024-11-09T02:57:33.077ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
121482024-11-09T02:57:33.077ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121492024-11-09T02:57:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
121502024-11-09T02:57:33.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121512024-11-09T02:57:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121522024-11-09T02:57:33.079ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
121532024-11-09T02:57:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
121542024-11-09T02:57:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121552024-11-09T02:57:33.079ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121562024-11-09T02:57:33.079ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121572024-11-09T02:57:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
121582024-11-09T02:57:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
121592024-11-09T02:57:33.081ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121602024-11-09T02:57:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121612024-11-09T02:57:33.083ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121622024-11-09T02:57:33.084ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121632024-11-09T02:57:33.084ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121642024-11-09T02:57:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121652024-11-09T02:57:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121662024-11-09T02:57:33.085ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121672024-11-09T02:57:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
121682024-11-09T02:57:33.086ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
121692024-11-09T02:57:33.086ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
121702024-11-09T02:57:33.087ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
121712024-11-09T02:57:33.087ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
121722024-11-09T02:57:33.088ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
121732024-11-09T02:57:33.091ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
121742024-11-09T02:57:33.091ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
121752024-11-09T02:57:33.091ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
121762024-11-09T02:57:33.091ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121772024-11-09T02:57:33.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121782024-11-09T02:57:33.093ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121792024-11-09T02:57:33.095ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
121802024-11-09T02:57:33.095ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 81.336191ms iteration = 67 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
121812024-11-09T02:57:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
121822024-11-09T02:57:33.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121832024-11-09T02:57:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121842024-11-09T02:57:33.097ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
121852024-11-09T02:57:33.097ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
121862024-11-09T02:57:33.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
121872024-11-09T02:57:33.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
121882024-11-09T02:57:33.101ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
121892024-11-09T02:57:33.101ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
121902024-11-09T02:57:33.101ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 88.08554ms iteration = 12 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
121912024-11-09T02:57:33.102ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.559361ms iteration = 23 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
121922024-11-09T02:57:33.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121932024-11-09T02:57:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121942024-11-09T02:57:33.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
121952024-11-09T02:57:33.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
121962024-11-09T02:57:33.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
121972024-11-09T02:57:33.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
121982024-11-09T02:57:33.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
121992024-11-09T02:57:33.115ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122002024-11-09T02:57:33.115ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
122012024-11-09T02:57:33.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
122022024-11-09T02:57:33.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
122032024-11-09T02:57:33.116ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 103.05092ms iteration = 67 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
122042024-11-09T02:57:33.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
122052024-11-09T02:57:33.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
122062024-11-09T02:57:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
122072024-11-09T02:57:33.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122082024-11-09T02:57:33.120ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.959781ms iteration = 23 status = 0
122092024-11-09T02:57:33.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
122102024-11-09T02:57:33.121ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122112024-11-09T02:57:33.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122122024-11-09T02:57:33.125ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
122132024-11-09T02:57:33.125ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
122142024-11-09T02:57:33.125ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
122152024-11-09T02:57:33.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122162024-11-09T02:57:33.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122172024-11-09T02:57:33.129ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122182024-11-09T02:57:33.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
122192024-11-09T02:57:33.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122202024-11-09T02:57:33.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122212024-11-09T02:57:33.136ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 123.078844ms iteration = 26 status = {"physical_disks_added":0}
122222024-11-09T02:57:33.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122232024-11-09T02:57:33.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
122242024-11-09T02:57:33.142ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
122252024-11-09T02:57:33.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
122262024-11-09T02:57:33.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122272024-11-09T02:57:33.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122282024-11-09T02:57:33.146ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
122292024-11-09T02:57:33.153ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
122302024-11-09T02:57:33.153ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
122312024-11-09T02:57:33.153ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
122322024-11-09T02:57:33.153ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 140.489274ms iteration = 13 status = {"generation":2}
122332024-11-09T02:57:33.162ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
122342024-11-09T02:57:33.162ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122352024-11-09T02:57:33.162ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "29b7f649-562e-492e-9641-9b3b4c9e55ea", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
122362024-11-09T02:57:33.162ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122372024-11-09T02:57:33.164ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
122382024-11-09T02:57:33.169ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
122392024-11-09T02:57:33.169ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
122402024-11-09T02:57:33.169ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 156.350041ms iteration = 23 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
122412024-11-09T02:57:33.182ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122422024-11-09T02:57:33.183ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122432024-11-09T02:57:33.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122442024-11-09T02:57:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122452024-11-09T02:57:33.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122462024-11-09T02:57:33.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122472024-11-09T02:57:33.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
122482024-11-09T02:57:33.187ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122492024-11-09T02:57:33.188ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbeaa53a-8b9b-40f6-be23-3fb8918cd5e3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
122502024-11-09T02:57:33.188ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122512024-11-09T02:57:33.193ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122522024-11-09T02:57:33.239ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
122532024-11-09T02:57:33.267ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
122542024-11-09T02:57:33.267ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 253.5398ms iteration = 12 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
122552024-11-09T02:57:33.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
122562024-11-09T02:57:33.289ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
122572024-11-09T02:57:33.289ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf2a26cb-0529-46c3-a437-9f0edc5ea0b2", "content-length": "26", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
122582024-11-09T02:57:33.289ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
122592024-11-09T02:57:33.291ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
122602024-11-09T02:57:33.291ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
122612024-11-09T02:57:33.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
122622024-11-09T02:57:33.291ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e8def734-cf3c-45a6-b70f-7ab58f734565", "content-length": "372", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
122632024-11-09T02:57:33.291ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
122642024-11-09T02:57:33.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
122652024-11-09T02:57:33.294ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122662024-11-09T02:57:33.298ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
122672024-11-09T02:57:33.298ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
122682024-11-09T02:57:33.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
122692024-11-09T02:57:33.319ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
122702024-11-09T02:57:33.320ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "16202945-5a33-4018-bd2b-fb36f0bc9423", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122712024-11-09T02:57:33.320ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122722024-11-09T02:57:33.322ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7ed4effa-2428-4674-9534-a2aafc8ec883", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122732024-11-09T02:57:33.322ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122742024-11-09T02:57:33.322ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
122752024-11-09T02:57:33.322ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
122762024-11-09T02:57:33.322ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
122772024-11-09T02:57:33.323ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
122782024-11-09T02:57:33.324ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122792024-11-09T02:57:33.324ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
122802024-11-09T02:57:33.324ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 311.392826ms iteration = 14 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
122812024-11-09T02:57:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122822024-11-09T02:57:33.326ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122832024-11-09T02:57:33.330ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122842024-11-09T02:57:33.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122852024-11-09T02:57:33.330ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
122862024-11-09T02:57:33.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122872024-11-09T02:57:33.331ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8810bec-4996-454b-90f1-0967ad41a9d1", "content-length": "1", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
122882024-11-09T02:57:33.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122892024-11-09T02:57:33.334ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
122902024-11-09T02:57:33.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
122912024-11-09T02:57:33.336ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 323.111027ms iteration = 23 status = null
122922024-11-09T02:57:33.336ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
122932024-11-09T02:57:33.336ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
122942024-11-09T02:57:33.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
122952024-11-09T02:57:33.350ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
122962024-11-09T02:57:33.350ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 337.087336ms iteration = 13 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
122972024-11-09T02:57:33.354ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
122982024-11-09T02:57:33.357ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
122992024-11-09T02:57:33.357ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
123002024-11-09T02:57:33.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
123012024-11-09T02:57:33.369ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
123022024-11-09T02:57:33.369ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
123032024-11-09T02:57:33.369ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
123042024-11-09T02:57:33.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 356.277483ms iteration = 13 status = {"generation":1}
123052024-11-09T02:57:33.370ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
123062024-11-09T02:57:33.370ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
123072024-11-09T02:57:33.371ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "728ce95e-1ada-4d2e-933a-8a4f7c9e926e", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
123082024-11-09T02:57:33.371ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123092024-11-09T02:57:33.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123102024-11-09T02:57:33.374ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123112024-11-09T02:57:33.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123122024-11-09T02:57:33.377ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
123132024-11-09T02:57:33.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
123142024-11-09T02:57:33.385ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
123152024-11-09T02:57:33.385ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
123162024-11-09T02:57:33.385ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "db431d81-a36f-4341-b268-33759db08e71", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
123172024-11-09T02:57:33.387ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.251744ms iteration = 23 status = {}
123182024-11-09T02:57:33.388ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 375.251104ms iteration = 24 status = {}
123192024-11-09T02:57:33.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
123202024-11-09T02:57:33.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123212024-11-09T02:57:33.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123222024-11-09T02:57:33.489ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
123232024-11-09T02:57:33.489ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "b9168993-847d-4eb5-af11-c7cdada52f9b", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123242024-11-09T02:57:33.489ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123252024-11-09T02:57:33.491ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "63e60cd7-ee1a-43a2-bc8c-f63ca5e3a548", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123262024-11-09T02:57:33.491ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123272024-11-09T02:57:33.493ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
123282024-11-09T02:57:33.493ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "345a23e9-a51a-477f-a6aa-f2be45820d5c", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123292024-11-09T02:57:33.493ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "5c800333-eb8f-4b90-ac9a-65651d34a956", "content-length": "691", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
123302024-11-09T02:57:33.493ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123312024-11-09T02:57:33.493ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
123322024-11-09T02:57:33.493ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
123332024-11-09T02:57:33.493ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
123342024-11-09T02:57:33.495ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 481.454179ms iteration = 23 status = {}
123352024-11-09T02:57:33.495ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
123362024-11-09T02:57:33.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123372024-11-09T02:57:33.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123382024-11-09T02:57:33.496ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
123392024-11-09T02:57:33.496ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 482.657774ms iteration = 14 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
123402024-11-09T02:57:33.504ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
123412024-11-09T02:57:33.504ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2ae4584c-c8f1-4086-ad38-3b7e6d4ccff3", "content-length": "134", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
123422024-11-09T02:57:33.504ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
123432024-11-09T02:57:33.504ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
123442024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
123452024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
123462024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123472024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123482024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123492024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123502024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
123512024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
123522024-11-09T02:57:33.505ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
123532024-11-09T02:57:33.505ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123542024-11-09T02:57:33.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123552024-11-09T02:57:33.508ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
123562024-11-09T02:57:33.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "61e17022-bfe1-4b86-8013-efdfeb45b362", "content-length": "2", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
123572024-11-09T02:57:33.508ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
123582024-11-09T02:57:33.508ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a9fe6e4-2a05-4158-83ae-50f6fb693422", "content-length": "52", "date": "Sat, 09 Nov 2024 02:57:32 GMT"} })
123592024-11-09T02:57:33.508ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
123602024-11-09T02:57:33.508ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
123612024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "5d8441eb-9b83-4b68-8a71-a95091d1d240", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
123622024-11-09T02:57:33.623ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
123632024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
123642024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "85ca1634-dd4c-42c5-9155-2bff435e2bad", "content-length": "682", "date": "Sat, 09 Nov 2024 02:57:33 GMT"} })
123652024-11-09T02:57:33.623ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123662024-11-09T02:57:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123672024-11-09T02:57:33.628ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123682024-11-09T02:57:33.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123692024-11-09T02:57:33.632ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123702024-11-09T02:57:33.632ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123712024-11-09T02:57:33.634ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
123722024-11-09T02:57:33.634ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
123732024-11-09T02:57:33.641ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 627.747522ms iteration = 23 status = {}
123742024-11-09T02:57:43.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 68 reason = Timeout
123752024-11-09T02:57:43.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 68 reason = Timeout
123762024-11-09T02:57:43.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123772024-11-09T02:57:43.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123782024-11-09T02:57:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123792024-11-09T02:57:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123802024-11-09T02:57:43.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123812024-11-09T02:57:43.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
123822024-11-09T02:57:43.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
123832024-11-09T02:57:43.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.514813ms iteration = 68 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
123842024-11-09T02:57:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
123852024-11-09T02:57:43.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123862024-11-09T02:57:43.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123872024-11-09T02:57:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123882024-11-09T02:57:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123892024-11-09T02:57:43.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
123902024-11-09T02:57:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
123912024-11-09T02:57:43.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
123922024-11-09T02:57:43.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
123932024-11-09T02:57:43.032ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
123942024-11-09T02:57:43.032ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.833929ms iteration = 68 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
123952024-11-09T02:57:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1484 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = c346f530-ab00-4f03-b905-fc567100457e response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
123962024-11-09T02:57:50.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2a3686b4-00bd-4382-807f-ac817b9c7a7e roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
123972024-11-09T02:57:50.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2a3686b4-00bd-4382-807f-ac817b9c7a7e resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
123982024-11-09T02:57:50.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2434 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2a3686b4-00bd-4382-807f-ac817b9c7a7e response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
123992024-11-09T02:57:50.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 65b26594-ddeb-4ad7-a80b-4ceb799a1d08 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
124002024-11-09T02:57:50.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 65b26594-ddeb-4ad7-a80b-4ceb799a1d08 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
124012024-11-09T02:57:50.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2783 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 65b26594-ddeb-4ad7-a80b-4ceb799a1d08 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
124022024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 69 reason = Timeout
124032024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124042024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 69 reason = Timeout
124052024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124062024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124072024-11-09T02:57:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124082024-11-09T02:57:53.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124092024-11-09T02:57:53.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124102024-11-09T02:57:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124112024-11-09T02:57:53.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.547094ms iteration = 69 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
124122024-11-09T02:57:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124132024-11-09T02:57:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124142024-11-09T02:57:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124152024-11-09T02:57:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124162024-11-09T02:57:53.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124172024-11-09T02:57:53.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124182024-11-09T02:57:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
124192024-11-09T02:57:53.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124202024-11-09T02:57:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124212024-11-09T02:57:53.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
124222024-11-09T02:57:53.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.934294ms iteration = 69 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
124232024-11-09T02:58:00.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1149 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 19b79409-67a0-4cc8-be7c-88db8967b1ba response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
124242024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 70 reason = Timeout
124252024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124262024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 70 reason = Timeout
124272024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 27 reason = Timeout
124282024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124292024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124302024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 24 reason = Timeout
124312024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 24 reason = Timeout
124322024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
124332024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
124342024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 25 reason = Timeout
124352024-11-09T02:58:03.014ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
124362024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 24 reason = Timeout
124372024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124382024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124392024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 24 reason = Timeout
124402024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 24 reason = Timeout
124412024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 24 reason = Timeout
124422024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 24 reason = Timeout
124432024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
124442024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
124452024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
124462024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 24 reason = Timeout
124472024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
124482024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 24 reason = Timeout
124492024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
124502024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124512024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 24 reason = Timeout
124522024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.42\u{b5}s iteration = 24 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
124532024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 24 reason = Timeout
124542024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 24 reason = Timeout
124552024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 4.56\u{b5}s iteration = 24 status = {"errors":[],"garbage_collect_requested":[]}
124562024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.451\u{b5}s iteration = 24 status = {"errors":[],"records_set_to_done":[]}
124572024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 24 reason = Timeout
124582024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 16.15\u{b5}s iteration = 24 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
124592024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124602024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124612024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124622024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124632024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124642024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
124652024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124662024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
124672024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
124682024-11-09T02:58:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
124692024-11-09T02:58:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
124702024-11-09T02:58:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
124712024-11-09T02:58:03.016ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124722024-11-09T02:58:03.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124732024-11-09T02:58:03.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
124742024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
124752024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124762024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.119355ms iteration = 24 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
124772024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124782024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
124792024-11-09T02:58:03.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
124802024-11-09T02:58:03.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
124812024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
124822024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
124832024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
124842024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
124852024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
124862024-11-09T02:58:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
124872024-11-09T02:58:03.021ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 357517777 } })
124882024-11-09T02:58:03.021ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
124892024-11-09T02:58:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
124902024-11-09T02:58:03.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
124912024-11-09T02:58:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124922024-11-09T02:58:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
124932024-11-09T02:58:03.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 358571749 } })
124942024-11-09T02:58:03.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
124952024-11-09T02:58:03.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
124962024-11-09T02:58:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
124972024-11-09T02:58:03.024ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
124982024-11-09T02:58:03.024ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
124992024-11-09T02:58:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
125002024-11-09T02:58:03.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
125012024-11-09T02:58:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
125022024-11-09T02:58:03.026ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 12.293704ms iteration = 70 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
125032024-11-09T02:58:03.027ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125042024-11-09T02:58:03.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125052024-11-09T02:58:03.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125062024-11-09T02:58:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125072024-11-09T02:58:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125082024-11-09T02:58:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125092024-11-09T02:58:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125102024-11-09T02:58:03.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1586, tv_nsec: 364737146 } })
125112024-11-09T02:58:03.029ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
125122024-11-09T02:58:03.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
125132024-11-09T02:58:03.029ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125142024-11-09T02:58:03.029ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125152024-11-09T02:58:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125162024-11-09T02:58:03.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125172024-11-09T02:58:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
125182024-11-09T02:58:03.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
125192024-11-09T02:58:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
125202024-11-09T02:58:03.032ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125212024-11-09T02:58:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125222024-11-09T02:58:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
125232024-11-09T02:58:03.033ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
125242024-11-09T02:58:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
125252024-11-09T02:58:03.040ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125262024-11-09T02:58:03.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125272024-11-09T02:58:03.041ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125282024-11-09T02:58:03.043ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125292024-11-09T02:58:03.043ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125302024-11-09T02:58:03.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125312024-11-09T02:58:03.044ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125322024-11-09T02:58:03.045ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
125332024-11-09T02:58:03.045ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 31.602222ms iteration = 70 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
125342024-11-09T02:58:03.046ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
125352024-11-09T02:58:03.046ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
125362024-11-09T02:58:03.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
125372024-11-09T02:58:03.047ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125382024-11-09T02:58:03.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125392024-11-09T02:58:03.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125402024-11-09T02:58:03.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125412024-11-09T02:58:03.051ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
125422024-11-09T02:58:03.052ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
125432024-11-09T02:58:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
125442024-11-09T02:58:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
125452024-11-09T02:58:03.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
125462024-11-09T02:58:03.054ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 40.260082ms iteration = 24 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
125472024-11-09T02:58:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
125482024-11-09T02:58:03.055ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125492024-11-09T02:58:03.055ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
125502024-11-09T02:58:03.055ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125512024-11-09T02:58:03.055ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125522024-11-09T02:58:03.056ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 41.878065ms iteration = 24 status = 0
125532024-11-09T02:58:03.058ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125542024-11-09T02:58:03.058ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
125552024-11-09T02:58:03.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
125562024-11-09T02:58:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
125572024-11-09T02:58:03.062ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
125582024-11-09T02:58:03.062ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 48.392991ms iteration = 24 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
125592024-11-09T02:58:03.072ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
125602024-11-09T02:58:03.072ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125612024-11-09T02:58:03.073ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4a0a5658-ce85-448d-b49e-4ab99f76bf5f", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
125622024-11-09T02:58:03.073ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125632024-11-09T02:58:03.074ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125642024-11-09T02:58:03.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
125652024-11-09T02:58:03.074ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125662024-11-09T02:58:03.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
125672024-11-09T02:58:03.074ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
125682024-11-09T02:58:03.075ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fa3dd00-22fa-4fef-9419-6128541b49a3", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
125692024-11-09T02:58:03.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125702024-11-09T02:58:03.075ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbc41fc2-ba20-4938-8068-09034812b498", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
125712024-11-09T02:58:03.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
125722024-11-09T02:58:03.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
125732024-11-09T02:58:03.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
125742024-11-09T02:58:03.094ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
125752024-11-09T02:58:03.094ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
125762024-11-09T02:58:03.094ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.803009ms iteration = 24 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
125772024-11-09T02:58:03.128ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 114.418465ms iteration = 27 status = {"physical_disks_added":0}
125782024-11-09T02:58:03.221ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
125792024-11-09T02:58:03.221ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
125802024-11-09T02:58:03.222ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "14a9159d-cf9c-4b34-92d5-7e3f1de7e584", "content-length": "372", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
125812024-11-09T02:58:03.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125822024-11-09T02:58:03.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125832024-11-09T02:58:03.232ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
125842024-11-09T02:58:03.232ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "07a5def1-5374-4607-bcf8-0c2bbfdd6313", "content-length": "691", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
125852024-11-09T02:58:03.232ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
125862024-11-09T02:58:03.232ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
125872024-11-09T02:58:03.232ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
125882024-11-09T02:58:03.233ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 219.557518ms iteration = 24 status = {}
125892024-11-09T02:58:03.238ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
125902024-11-09T02:58:03.238ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
125912024-11-09T02:58:03.238ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "1bec86b1-939a-4699-8aee-9723e3cf251f", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
125922024-11-09T02:58:03.238ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125932024-11-09T02:58:03.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125942024-11-09T02:58:03.241ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125952024-11-09T02:58:03.241ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125962024-11-09T02:58:03.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
125972024-11-09T02:58:03.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
125982024-11-09T02:58:03.247ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
125992024-11-09T02:58:03.247ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
126002024-11-09T02:58:03.247ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "30dbb9b9-5703-4c82-a654-f6cfdb72beac", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
126012024-11-09T02:58:03.249ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 235.089029ms iteration = 25 status = {}
126022024-11-09T02:58:03.291ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 277.192369ms iteration = 24 status = {}
126032024-11-09T02:58:03.291ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
126042024-11-09T02:58:03.292ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfaaaf1b-6537-4a7c-a88b-c5c788fd1d2a", "content-length": "1", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
126052024-11-09T02:58:03.294ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
126062024-11-09T02:58:03.294ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
126072024-11-09T02:58:03.296ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 282.646872ms iteration = 24 status = null
126082024-11-09T02:58:03.326ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126092024-11-09T02:58:03.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126102024-11-09T02:58:03.328ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
126112024-11-09T02:58:03.328ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126122024-11-09T02:58:03.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126132024-11-09T02:58:03.336ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
126142024-11-09T02:58:03.337ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "56017d84-5b55-418d-80a6-0a50d80ea2c0", "content-length": "134", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
126152024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
126162024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
126172024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
126182024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
126192024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126202024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126212024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126222024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126232024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
126242024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
126252024-11-09T02:58:03.337ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
126262024-11-09T02:58:03.337ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126272024-11-09T02:58:03.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126282024-11-09T02:58:03.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
126292024-11-09T02:58:03.339ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "843ad216-68a0-4ef9-8a38-2bd565ba14ed", "content-length": "2", "date": "Sat, 09 Nov 2024 02:58:02 GMT"} })
126302024-11-09T02:58:03.339ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
126312024-11-09T02:58:03.340ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "623c724a-9290-4450-a677-a3e250168f97", "content-length": "52", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
126322024-11-09T02:58:03.340ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
126332024-11-09T02:58:03.340ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
126342024-11-09T02:58:03.458ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "bf82febb-1f25-4f81-9997-c2025fd7a918", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
126352024-11-09T02:58:03.458ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
126362024-11-09T02:58:03.458ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
126372024-11-09T02:58:03.459ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e1266bd-be28-4062-848f-6d3d54ea6762", "content-length": "682", "date": "Sat, 09 Nov 2024 02:58:03 GMT"} })
126382024-11-09T02:58:03.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126392024-11-09T02:58:03.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126402024-11-09T02:58:03.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126412024-11-09T02:58:03.463ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126422024-11-09T02:58:03.466ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126432024-11-09T02:58:03.467ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126442024-11-09T02:58:03.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
126452024-11-09T02:58:03.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
126462024-11-09T02:58:03.475ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 460.812373ms iteration = 24 status = {}
126472024-11-09T02:58:05.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = bafd0c57-f254-427c-a09e-27c93ba9ae72 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
126482024-11-09T02:58:05.145ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = bafd0c57-f254-427c-a09e-27c93ba9ae72 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
126492024-11-09T02:58:05.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2896 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = bafd0c57-f254-427c-a09e-27c93ba9ae72 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
126502024-11-09T02:58:05.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 88923d90-85b0-4e38-88be-aac0fb7fcf24 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
126512024-11-09T02:58:05.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 88923d90-85b0-4e38-88be-aac0fb7fcf24 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
126522024-11-09T02:58:05.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2223 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 88923d90-85b0-4e38-88be-aac0fb7fcf24 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
126532024-11-09T02:58:13.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 71 reason = Timeout
126542024-11-09T02:58:13.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 71 reason = Timeout
126552024-11-09T02:58:13.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126562024-11-09T02:58:13.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126572024-11-09T02:58:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126582024-11-09T02:58:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126592024-11-09T02:58:13.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126602024-11-09T02:58:13.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126612024-11-09T02:58:13.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126622024-11-09T02:58:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126632024-11-09T02:58:13.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126642024-11-09T02:58:13.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126652024-11-09T02:58:13.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126662024-11-09T02:58:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126672024-11-09T02:58:13.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126682024-11-09T02:58:13.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
126692024-11-09T02:58:13.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126702024-11-09T02:58:13.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126712024-11-09T02:58:13.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
126722024-11-09T02:58:13.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.048707ms iteration = 71 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
126732024-11-09T02:58:13.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.710794ms iteration = 71 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126742024-11-09T02:58:15.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1391 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 83911c1e-5dae-4eb9-9fbe-293bb042602f response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
126752024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 72 reason = Timeout
126762024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 72 reason = Timeout
126772024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126782024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126792024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126802024-11-09T02:58:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126812024-11-09T02:58:23.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126822024-11-09T02:58:23.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
126832024-11-09T02:58:23.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
126842024-11-09T02:58:23.018ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.397691ms iteration = 72 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
126852024-11-09T02:58:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
126862024-11-09T02:58:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126872024-11-09T02:58:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126882024-11-09T02:58:23.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126892024-11-09T02:58:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126902024-11-09T02:58:23.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
126912024-11-09T02:58:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
126922024-11-09T02:58:23.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
126932024-11-09T02:58:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
126942024-11-09T02:58:23.034ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
126952024-11-09T02:58:23.034ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.141476ms iteration = 72 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
126962024-11-09T02:58:30.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1226 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = f8714a9b-2f25-4c5f-baf3-77bc5e1936ad response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
126972024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 15 reason = Timeout
126982024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 14 reason = Timeout
126992024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 25 reason = Timeout
127002024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 25 reason = Timeout
127012024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
127022024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 26 reason = Timeout
127032024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 13 reason = Timeout
127042024-11-09T02:58:33.014ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
127052024-11-09T02:58:33.014ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:48:33.014329661 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
127062024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 14 reason = Timeout
127072024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 73 reason = Timeout
127082024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
127092024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
127102024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 14 reason = Timeout
127112024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
127122024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 15 reason = Timeout
127132024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
127142024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 6 reason = Timeout
127152024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127162024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 28 reason = Timeout
127172024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 25 reason = Timeout
127182024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
127192024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
127202024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 25 reason = Timeout
127212024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 73 reason = Timeout
127222024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 25 reason = Timeout
127232024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 25 reason = Timeout
127242024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
127252024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
127262024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
127272024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
127282024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 25 reason = Timeout
127292024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
127302024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 25 reason = Timeout
127312024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
127322024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
127332024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 14 reason = Timeout
127342024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
127352024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
127362024-11-09T02:58:33.014ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 13 reason = Timeout
127372024-11-09T02:58:33.014ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
127382024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 14 reason = Timeout
127392024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
127402024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
127412024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
127422024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 14 reason = Timeout
127432024-11-09T02:58:33.015ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
127442024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.42\u{b5}s iteration = 14 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
127452024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 13 reason = Timeout
127462024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 25 reason = Timeout
127472024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
127482024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
127492024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 25 reason = Timeout
127502024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 13.651\u{b5}s iteration = 25 status = {"errors":[],"garbage_collect_requested":[]}
127512024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 25 reason = Timeout
127522024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 25 reason = Timeout
127532024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.5\u{b5}s iteration = 25 status = {"errors":[],"records_set_to_done":[]}
127542024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 25 reason = Timeout
127552024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 17.79\u{b5}s iteration = 25 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
127562024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 5.88\u{b5}s iteration = 25 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
127572024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 13 reason = Timeout
127582024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
127592024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 13 reason = Timeout
127602024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
127612024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
127622024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
127632024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127642024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127652024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
127662024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
127672024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
127682024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
127692024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
127702024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
127712024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
127722024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
127732024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
127742024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
127752024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
127762024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
127772024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
127782024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
127792024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
127802024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
127812024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127822024-11-09T02:58:33.015ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 351024943 } })
127832024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127842024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
127852024-11-09T02:58:33.015ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 351025853 } })
127862024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
127872024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127882024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127892024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127902024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
127912024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
127922024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.532172ms iteration = 14 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
127932024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
127942024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.505911ms iteration = 14 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
127952024-11-09T02:58:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
127962024-11-09T02:58:33.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127972024-11-09T02:58:33.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.845559ms iteration = 25 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
127982024-11-09T02:58:33.018ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
127992024-11-09T02:58:33.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 354104036 } })
128002024-11-09T02:58:33.018ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
128012024-11-09T02:58:33.019ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128022024-11-09T02:58:33.019ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:48:33.014329661 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
128032024-11-09T02:58:33.019ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.523304ms iteration = 13 status = {"expiration":"2024-11-09T02:48:33.014329661Z","pruned":[]}
128042024-11-09T02:58:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
128052024-11-09T02:58:33.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128062024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128072024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128082024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128092024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128102024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
128112024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
128122024-11-09T02:58:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
128132024-11-09T02:58:33.023ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128142024-11-09T02:58:33.023ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
128152024-11-09T02:58:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
128162024-11-09T02:58:33.023ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128172024-11-09T02:58:33.024ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128182024-11-09T02:58:33.025ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 361299365 } })
128192024-11-09T02:58:33.025ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
128202024-11-09T02:58:33.025ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128212024-11-09T02:58:33.025ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
128222024-11-09T02:58:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128232024-11-09T02:58:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
128242024-11-09T02:58:33.026ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
128252024-11-09T02:58:33.026ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
128262024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
128272024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
128282024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
128292024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
128302024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
128312024-11-09T02:58:33.027ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128322024-11-09T02:58:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
128332024-11-09T02:58:33.031ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128342024-11-09T02:58:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128352024-11-09T02:58:33.031ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128362024-11-09T02:58:33.032ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
128372024-11-09T02:58:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
128382024-11-09T02:58:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
128392024-11-09T02:58:33.033ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
128402024-11-09T02:58:33.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
128412024-11-09T02:58:33.034ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128422024-11-09T02:58:33.035ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128432024-11-09T02:58:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
128442024-11-09T02:58:33.037ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128452024-11-09T02:58:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128462024-11-09T02:58:33.037ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128472024-11-09T02:58:33.037ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128482024-11-09T02:58:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128492024-11-09T02:58:33.039ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 25.197201ms iteration = 13 status = {"errors":[],"found_port_ok":[]}
128502024-11-09T02:58:33.040ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128512024-11-09T02:58:33.041ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128522024-11-09T02:58:33.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128532024-11-09T02:58:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128542024-11-09T02:58:33.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128552024-11-09T02:58:33.042ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128562024-11-09T02:58:33.042ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128572024-11-09T02:58:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128582024-11-09T02:58:33.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128592024-11-09T02:58:33.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128602024-11-09T02:58:33.044ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128612024-11-09T02:58:33.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.587563ms iteration = 73 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
128622024-11-09T02:58:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
128632024-11-09T02:58:33.047ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
128642024-11-09T02:58:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
128652024-11-09T02:58:33.047ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128662024-11-09T02:58:33.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128672024-11-09T02:58:33.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1616, tv_nsec: 383739729 } })
128682024-11-09T02:58:33.048ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128692024-11-09T02:58:33.048ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
128702024-11-09T02:58:33.050ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128712024-11-09T02:58:33.050ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
128722024-11-09T02:58:33.051ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
128732024-11-09T02:58:33.053ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
128742024-11-09T02:58:33.053ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
128752024-11-09T02:58:33.053ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 39.336993ms iteration = 13 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
128762024-11-09T02:58:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
128772024-11-09T02:58:33.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
128782024-11-09T02:58:33.057ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
128792024-11-09T02:58:33.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
128802024-11-09T02:58:33.057ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128812024-11-09T02:58:33.059ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 44.827797ms iteration = 6 status = {"nsuccess":5}
128822024-11-09T02:58:33.059ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
128832024-11-09T02:58:33.061ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
128842024-11-09T02:58:33.062ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
128852024-11-09T02:58:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
128862024-11-09T02:58:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
128872024-11-09T02:58:33.062ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
128882024-11-09T02:58:33.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
128892024-11-09T02:58:33.066ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
128902024-11-09T02:58:33.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
128912024-11-09T02:58:33.071ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
128922024-11-09T02:58:33.071ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
128932024-11-09T02:58:33.071ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 56.244842ms iteration = 13 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
128942024-11-09T02:58:33.078ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
128952024-11-09T02:58:33.078ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
128962024-11-09T02:58:33.078ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
128972024-11-09T02:58:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
128982024-11-09T02:58:33.079ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
128992024-11-09T02:58:33.080ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 65.634576ms iteration = 73 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
129002024-11-09T02:58:33.081ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129012024-11-09T02:58:33.081ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129022024-11-09T02:58:33.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129032024-11-09T02:58:33.082ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129042024-11-09T02:58:33.082ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
129052024-11-09T02:58:33.082ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
129062024-11-09T02:58:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
129072024-11-09T02:58:33.085ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
129082024-11-09T02:58:33.085ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
129092024-11-09T02:58:33.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
129102024-11-09T02:58:33.094ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129112024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129122024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
129132024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
129142024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
129152024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129162024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
129172024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
129182024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
129192024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129202024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129212024-11-09T02:58:33.095ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129222024-11-09T02:58:33.096ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129232024-11-09T02:58:33.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129242024-11-09T02:58:33.096ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129252024-11-09T02:58:33.097ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129262024-11-09T02:58:33.097ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129272024-11-09T02:58:33.099ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129282024-11-09T02:58:33.099ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
129292024-11-09T02:58:33.099ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129302024-11-09T02:58:33.099ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129312024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
129322024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129332024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
129342024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
129352024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129362024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129372024-11-09T02:58:33.101ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129382024-11-09T02:58:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129392024-11-09T02:58:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
129402024-11-09T02:58:33.102ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
129412024-11-09T02:58:33.102ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
129422024-11-09T02:58:33.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129432024-11-09T02:58:33.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.564254ms iteration = 25 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
129442024-11-09T02:58:33.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129452024-11-09T02:58:33.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
129462024-11-09T02:58:33.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
129472024-11-09T02:58:33.128ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
129482024-11-09T02:58:33.128ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
129492024-11-09T02:58:33.128ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 114.295242ms iteration = 25 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
129502024-11-09T02:58:33.154ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
129512024-11-09T02:58:33.171ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
129522024-11-09T02:58:33.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
129532024-11-09T02:58:33.179ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129542024-11-09T02:58:33.183ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fd9b932b-54f4-4fab-aab2-ba1d4ed800f1", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:32 GMT"} })
129552024-11-09T02:58:33.183ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129562024-11-09T02:58:33.185ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129572024-11-09T02:58:33.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
129582024-11-09T02:58:33.212ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129592024-11-09T02:58:33.213ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e21def44-3ebf-42bf-a6e5-8b8c9026725d", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:32 GMT"} })
129602024-11-09T02:58:33.213ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129612024-11-09T02:58:33.217ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
129622024-11-09T02:58:33.223ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
129632024-11-09T02:58:33.224ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
129642024-11-09T02:58:33.224ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d246cfc3-6a08-4b8d-8839-bd1f9b67dcf9", "content-length": "26", "date": "Sat, 09 Nov 2024 02:58:32 GMT"} })
129652024-11-09T02:58:33.224ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
129662024-11-09T02:58:33.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
129672024-11-09T02:58:33.343ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = instance_watcher body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vmms/cb313128-bef6-4891-a142-8c709c04545b/state
129682024-11-09T02:58:33.343ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
129692024-11-09T02:58:33.345ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129702024-11-09T02:58:33.346ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129712024-11-09T02:58:33.349ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
129722024-11-09T02:58:33.349ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
129732024-11-09T02:58:33.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
129742024-11-09T02:58:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
129752024-11-09T02:58:33.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
129762024-11-09T02:58:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
129772024-11-09T02:58:33.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129782024-11-09T02:58:33.359ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 344.787686ms iteration = 25 status = 0
129792024-11-09T02:58:33.361ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
129802024-11-09T02:58:33.361ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
129812024-11-09T02:58:33.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
129822024-11-09T02:58:33.373ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
129832024-11-09T02:58:33.373ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0746cd49-74bc-4a05-b34a-1bf5f9392206", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129842024-11-09T02:58:33.373ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129852024-11-09T02:58:33.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "361dbb4f-314b-4bde-8bfb-17257ea2d04d", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129862024-11-09T02:58:33.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129872024-11-09T02:58:33.381ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
129882024-11-09T02:58:33.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 366.78019ms iteration = 15 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
129892024-11-09T02:58:33.395ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
129902024-11-09T02:58:33.395ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
129912024-11-09T02:58:33.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
129922024-11-09T02:58:33.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
129932024-11-09T02:58:33.397ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
129942024-11-09T02:58:33.398ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
129952024-11-09T02:58:33.398ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "55c1f957-00e6-4009-98d3-ba8447e87be0", "content-length": "1", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
129962024-11-09T02:58:33.399ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
129972024-11-09T02:58:33.399ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
129982024-11-09T02:58:33.399ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
129992024-11-09T02:58:33.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130002024-11-09T02:58:33.400ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
130012024-11-09T02:58:33.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
130022024-11-09T02:58:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
130032024-11-09T02:58:33.402ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
130042024-11-09T02:58:33.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
130052024-11-09T02:58:33.405ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 390.640933ms iteration = 25 status = null
130062024-11-09T02:58:33.405ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
130072024-11-09T02:58:33.405ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
130082024-11-09T02:58:33.405ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
130092024-11-09T02:58:33.405ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 391.190844ms iteration = 14 status = {"generation":1}
130102024-11-09T02:58:33.417ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
130112024-11-09T02:58:33.417ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 403.09807ms iteration = 14 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
130122024-11-09T02:58:33.433ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 418.766634ms iteration = 25 status = {}
130132024-11-09T02:58:33.445ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130142024-11-09T02:58:33.449ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
130152024-11-09T02:58:33.449ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
130162024-11-09T02:58:33.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
130172024-11-09T02:58:33.451ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
130182024-11-09T02:58:33.451ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
130192024-11-09T02:58:33.452ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
130202024-11-09T02:58:33.452ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 437.396119ms iteration = 14 status = {"generation":2}
130212024-11-09T02:58:33.468ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
130222024-11-09T02:58:33.469ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b97fcddf-cdf4-48a5-ada0-ce641c5583d9", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130232024-11-09T02:58:33.469ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130242024-11-09T02:58:33.471ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "f455a39d-7929-4efd-96f7-846e65f141ed", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130252024-11-09T02:58:33.471ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130262024-11-09T02:58:33.474ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "68ea2aa4-3533-4e63-b6e6-74540466d894", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130272024-11-09T02:58:33.474ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130282024-11-09T02:58:33.476ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
130292024-11-09T02:58:33.476ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 462.292373ms iteration = 15 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
130302024-11-09T02:58:33.480ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
130312024-11-09T02:58:33.480ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
130322024-11-09T02:58:33.480ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "31eb2a02-7796-4360-bac7-5efe7682b8fc", "content-length": "523", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
130332024-11-09T02:58:33.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130342024-11-09T02:58:33.481ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130352024-11-09T02:58:33.491ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
130362024-11-09T02:58:33.491ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 476.891945ms iteration = 13 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
130372024-11-09T02:58:33.497ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 483.066952ms iteration = 28 status = {"physical_disks_added":0}
130382024-11-09T02:58:33.541ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {2945403d-7dac-4915-b39b-33737fbebf32: {10.151.1.176: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}, 10.151.1.175: {0df7e5b9-3539-48e3-9b34-00c5061bdee6}}} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
130392024-11-09T02:58:33.541ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
130402024-11-09T02:58:33.541ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e4abd016-d9c5-414b-8631-aa9ea025f61a", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
130412024-11-09T02:58:33.541ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130422024-11-09T02:58:33.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130432024-11-09T02:58:33.544ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
130442024-11-09T02:58:33.544ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e30e78d3-b859-404a-8be8-9379b21ff144", "content-length": "810", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
130452024-11-09T02:58:33.544ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {VirtualNetworkInterfaceHost { physical_host_ip: fd00:1122:3344:101::1, virtual_ip: 172.30.0.5, virtual_mac: MacAddr(MacAddr6([168, 64, 37, 240, 0, 0])), vni: Vni(1603470) }} sled = buskin
130462024-11-09T02:58:33.544ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
130472024-11-09T02:58:33.544ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
130482024-11-09T02:58:33.545ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130492024-11-09T02:58:33.545ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130502024-11-09T02:58:33.547ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 533.105917ms iteration = 25 status = {}
130512024-11-09T02:58:33.549ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130522024-11-09T02:58:33.550ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130532024-11-09T02:58:33.554ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130542024-11-09T02:58:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130552024-11-09T02:58:33.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130562024-11-09T02:58:33.558ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130572024-11-09T02:58:33.561ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130582024-11-09T02:58:33.562ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130592024-11-09T02:58:33.565ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
130602024-11-09T02:58:33.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130612024-11-09T02:58:33.566ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130622024-11-09T02:58:33.567ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130632024-11-09T02:58:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130642024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130652024-11-09T02:58:33.570ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130662024-11-09T02:58:33.572ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130672024-11-09T02:58:33.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130682024-11-09T02:58:33.575ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130692024-11-09T02:58:33.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130702024-11-09T02:58:33.576ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130712024-11-09T02:58:33.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130722024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130732024-11-09T02:58:33.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130742024-11-09T02:58:33.580ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130752024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 9b48d22c-54e6-4042-96aa-71189997f7be, lookup_type: ById(9b48d22c-54e6-4042-96aa-71189997f7be) }, key: 2bc1c013-f3c1-4db1-bb74-56e3984db9d8, lookup_type: ById(2bc1c013-f3c1-4db1-bb74-56e3984db9d8) } result = Ok(())
130762024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130772024-11-09T02:58:33.585ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130782024-11-09T02:58:33.587ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130792024-11-09T02:58:33.587ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130802024-11-09T02:58:33.588ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130812024-11-09T02:58:33.588ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130822024-11-09T02:58:33.590ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
130832024-11-09T02:58:33.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130842024-11-09T02:58:33.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130852024-11-09T02:58:33.594ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 9b48d22c-54e6-4042-96aa-71189997f7be, lookup_type: ById(9b48d22c-54e6-4042-96aa-71189997f7be) }, key: 2bc1c013-f3c1-4db1-bb74-56e3984db9d8, lookup_type: ById(2bc1c013-f3c1-4db1-bb74-56e3984db9d8) } result = Ok(())
130862024-11-09T02:58:33.594ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130872024-11-09T02:58:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130882024-11-09T02:58:33.594ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
130892024-11-09T02:58:33.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
130902024-11-09T02:58:33.594ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
130912024-11-09T02:58:33.598ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130922024-11-09T02:58:33.598ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130932024-11-09T02:58:33.600ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130942024-11-09T02:58:33.600ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130952024-11-09T02:58:33.602ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130962024-11-09T02:58:33.602ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130972024-11-09T02:58:33.604ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
130982024-11-09T02:58:33.604ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
130992024-11-09T02:58:33.605ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
131002024-11-09T02:58:33.605ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3ce293a-2199-426b-b293-ae1c74aee641", "content-length": "134", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131012024-11-09T02:58:33.605ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
131022024-11-09T02:58:33.605ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
131032024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
131042024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
131052024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131062024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131072024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131082024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131092024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
131102024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
131112024-11-09T02:58:33.606ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
131122024-11-09T02:58:33.606ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131132024-11-09T02:58:33.606ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131142024-11-09T02:58:33.607ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131152024-11-09T02:58:33.607ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131162024-11-09T02:58:33.608ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131172024-11-09T02:58:33.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131182024-11-09T02:58:33.610ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131192024-11-09T02:58:33.610ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
131202024-11-09T02:58:33.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "875a2c9e-09e9-47e3-b890-15861588c644", "content-length": "2", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131212024-11-09T02:58:33.611ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
131222024-11-09T02:58:33.611ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "486abe84-10ab-4106-991e-e03d1cbbc328", "content-length": "52", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131232024-11-09T02:58:33.611ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
131242024-11-09T02:58:33.611ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
131252024-11-09T02:58:33.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131262024-11-09T02:58:33.615ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131272024-11-09T02:58:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 9b48d22c-54e6-4042-96aa-71189997f7be, lookup_type: ById(9b48d22c-54e6-4042-96aa-71189997f7be) }, key: 2dbda561-8a57-49ef-ae62-fd7359e3af11, lookup_type: ByName("default") } result = Ok(())
131282024-11-09T02:58:33.620ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131292024-11-09T02:58:33.620ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131302024-11-09T02:58:33.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131312024-11-09T02:58:33.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131322024-11-09T02:58:33.624ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131332024-11-09T02:58:33.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131342024-11-09T02:58:33.626ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131352024-11-09T02:58:33.626ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131362024-11-09T02:58:33.629ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131372024-11-09T02:58:33.629ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131382024-11-09T02:58:33.631ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131392024-11-09T02:58:33.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131402024-11-09T02:58:33.633ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
131412024-11-09T02:58:33.633ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
131422024-11-09T02:58:33.634ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131432024-11-09T02:58:33.639ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, lookup_type: ById(8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd) }, key: 5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb, lookup_type: ById(5ad6fbb0-2a15-4329-9a4a-4ec092cd06bb) }, key: 9b48d22c-54e6-4042-96aa-71189997f7be, lookup_type: ById(9b48d22c-54e6-4042-96aa-71189997f7be) }, key: 0df7e5b9-3539-48e3-9b34-00c5061bdee6, lookup_type: ByName("default") } result = Ok(())
131442024-11-09T02:58:33.639ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
131452024-11-09T02:58:33.640ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "07d0ce69-c7e0-4461-84ca-9aad9d955e70", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131462024-11-09T02:58:33.642ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 628.385076ms iteration = 26 status = {}
131472024-11-09T02:58:33.753ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "72fb9e33-0d86-460d-999a-b6a14028671f", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131482024-11-09T02:58:33.753ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
131492024-11-09T02:58:33.753ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
131502024-11-09T02:58:33.761ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "3591d9c9-30cd-44a8-8d5c-74baaffd51b9", "content-length": "682", "date": "Sat, 09 Nov 2024 02:58:33 GMT"} })
131512024-11-09T02:58:33.761ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131522024-11-09T02:58:33.761ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131532024-11-09T02:58:33.765ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131542024-11-09T02:58:33.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131552024-11-09T02:58:33.770ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131562024-11-09T02:58:33.771ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131572024-11-09T02:58:33.773ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
131582024-11-09T02:58:33.774ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
131592024-11-09T02:58:33.782ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 768.253227ms iteration = 25 status = {}
131602024-11-09T02:58:35.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3a5dca21-e745-49f1-80cb-ec9f43fcfe36 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
131612024-11-09T02:58:35.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3a5dca21-e745-49f1-80cb-ec9f43fcfe36 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
131622024-11-09T02:58:35.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 3a5dca21-e745-49f1-80cb-ec9f43fcfe36 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
131632024-11-09T02:58:35.147ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = edd35031-fe7e-4751-9364-a2d6295398ef roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
131642024-11-09T02:58:35.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = edd35031-fe7e-4751-9364-a2d6295398ef resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
131652024-11-09T02:58:35.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2723 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = edd35031-fe7e-4751-9364-a2d6295398ef response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
131662024-11-09T02:58:39.993ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = instance_watcher result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vmms/cb313128-bef6-4891-a142-8c709c04545b/state", status: 200, headers: {"content-type": "application/json", "x-request-id": "97dd0bc5-fc52-4bda-af8a-7ad22067d02a", "content-length": "131", "date": "Sat, 09 Nov 2024 02:58:39 GMT"} })
131672024-11-09T02:58:39.999ZDEBGnexus (BackgroundTasks): updating instance state background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 state = SledVmmState { vmm_state: VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T02:58:31.725276121Z }, migration_in: None, migration_out: None } vmm_id = cb313128-bef6-4891-a142-8c709c04545b
131682024-11-09T02:58:39.999ZINFOnexus (BackgroundTasks): received new VMM runtime state from sled agent background_task = instance_watcher file = nexus/src/app/instance.rs:2151 instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 migration_state = Migrations { migration_in: None, migration_out: None } propolis_id = cb313128-bef6-4891-a142-8c709c04545b sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b vmm_state = VmmRuntimeState { state: Starting, gen: Generation(2), time_updated: 2024-11-09T02:58:31.725276121Z }
131692024-11-09T02:58:39.999ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 roles = RoleSet { roles: {} } sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b
131702024-11-09T02:58:39.999ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher instance_id = 80b85a0b-333c-468c-9cee-5d2eba219497 resource = Database result = Ok(()) sled_id = f032ba4a-ac68-41c0-a068-00d3371df648 vmm_id = cb313128-bef6-4891-a142-8c709c04545b
131712024-11-09T02:58:40.002ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 1 total_failed = 0 total_incomplete = 0 total_instances = 1 update_sagas_queued = 0
131722024-11-09T02:58:40.004ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 6.990273551s iteration = 25 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{"starting":1},"pruned_instances":0,"total_instances":1,"update_sagas_queued":0}
131732024-11-09T02:58:40.029ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1:0]:63618
131742024-11-09T02:58:40.029ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63618 req_id = c4b0052b-70d9-474f-a6cc-6b633f5a5cb0 roles = RoleSet { roles: {} } uri = /metrics/producers
131752024-11-09T02:58:40.029ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63618 req_id = c4b0052b-70d9-474f-a6cc-6b633f5a5cb0 resource = Database result = Ok(()) uri = /metrics/producers
131762024-11-09T02:58:40.064ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 80b85a0b-333c-468c-9cee-5d2eba219497
131772024-11-09T02:58:40.064ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35563 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1:0]:63618 req_id = c4b0052b-70d9-474f-a6cc-6b633f5a5cb0 response_code = 201 uri = /metrics/producers
131782024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 74 reason = Timeout
131792024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 74 reason = Timeout
131802024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131812024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131822024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131832024-11-09T02:58:43.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131842024-11-09T02:58:43.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131852024-11-09T02:58:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
131862024-11-09T02:58:43.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131872024-11-09T02:58:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131882024-11-09T02:58:43.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131892024-11-09T02:58:43.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131902024-11-09T02:58:43.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
131912024-11-09T02:58:43.028ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
131922024-11-09T02:58:43.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
131932024-11-09T02:58:43.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
131942024-11-09T02:58:43.043ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
131952024-11-09T02:58:43.043ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 29.575441ms iteration = 74 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
131962024-11-09T02:58:43.049ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
131972024-11-09T02:58:43.050ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
131982024-11-09T02:58:43.079ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 65.435782ms iteration = 74 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
131992024-11-09T02:58:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1178 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = dc6e0109-15d5-4583-88c8-f488f9e31a9d response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
132002024-11-09T02:58:50.145ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7551919d-6265-44ec-a706-1996947fa51b roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
132012024-11-09T02:58:50.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7551919d-6265-44ec-a706-1996947fa51b resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
132022024-11-09T02:58:50.147ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2273 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 7551919d-6265-44ec-a706-1996947fa51b response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
132032024-11-09T02:58:50.148ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f268351c-b420-4e7e-89d8-ae8502bdc1e1 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
132042024-11-09T02:58:50.148ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f268351c-b420-4e7e-89d8-ae8502bdc1e1 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
132052024-11-09T02:58:50.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2388 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = f268351c-b420-4e7e-89d8-ae8502bdc1e1 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
132062024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 75 reason = Timeout
132072024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 75 reason = Timeout
132082024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132092024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132102024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132112024-11-09T02:58:53.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132122024-11-09T02:58:53.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132132024-11-09T02:58:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132142024-11-09T02:58:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132152024-11-09T02:58:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132162024-11-09T02:58:53.020ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132172024-11-09T02:58:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132182024-11-09T02:58:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132192024-11-09T02:58:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132202024-11-09T02:58:53.021ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.820331ms iteration = 75 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
132212024-11-09T02:58:53.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132222024-11-09T02:58:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
132232024-11-09T02:58:53.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132242024-11-09T02:58:53.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132252024-11-09T02:58:53.035ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
132262024-11-09T02:58:53.035ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.948313ms iteration = 75 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
132272024-11-09T02:59:00.152ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1091 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 8f0eb082-562e-4985-95cc-57a2a41f0268 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
132282024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 76 reason = Timeout
132292024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 76 reason = Timeout
132302024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132312024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 26 reason = Timeout
132322024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132332024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 26 reason = Timeout
132342024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
132352024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132362024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 26 reason = Timeout
132372024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
132382024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 27 reason = Timeout
132392024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 26 reason = Timeout
132402024-11-09T02:59:03.013ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
132412024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
132422024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 26 reason = Timeout
132432024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132442024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 26 reason = Timeout
132452024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
132462024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 26 reason = Timeout
132472024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 26 reason = Timeout
132482024-11-09T02:59:03.013ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
132492024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
132502024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 26 reason = Timeout
132512024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
132522024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132532024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 29 reason = Timeout
132542024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
132552024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132562024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132572024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132582024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
132592024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
132602024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
132612024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
132622024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
132632024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132642024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
132652024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
132662024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132672024-11-09T02:59:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 26 reason = Timeout
132682024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 26 reason = Timeout
132692024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.84\u{b5}s iteration = 26 status = {"errors":[],"records_set_to_done":[]}
132702024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.74\u{b5}s iteration = 26 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
132712024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 26 reason = Timeout
132722024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 26 reason = Timeout
132732024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.591\u{b5}s iteration = 26 status = {"errors":[],"garbage_collect_requested":[]}
132742024-11-09T02:59:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.431\u{b5}s iteration = 26 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
132752024-11-09T02:59:03.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
132762024-11-09T02:59:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
132772024-11-09T02:59:03.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132782024-11-09T02:59:03.017ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132792024-11-09T02:59:03.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.34179ms iteration = 26 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
132802024-11-09T02:59:03.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 354347151 } })
132812024-11-09T02:59:03.019ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
132822024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
132832024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
132842024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
132852024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
132862024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
132872024-11-09T02:59:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
132882024-11-09T02:59:03.022ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 358153030 } })
132892024-11-09T02:59:03.022ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
132902024-11-09T02:59:03.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132912024-11-09T02:59:03.023ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132922024-11-09T02:59:03.024ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
132932024-11-09T02:59:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
132942024-11-09T02:59:03.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
132952024-11-09T02:59:03.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
132962024-11-09T02:59:03.026ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
132972024-11-09T02:59:03.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
132982024-11-09T02:59:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
132992024-11-09T02:59:03.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133002024-11-09T02:59:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133012024-11-09T02:59:03.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133022024-11-09T02:59:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133032024-11-09T02:59:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133042024-11-09T02:59:03.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133052024-11-09T02:59:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133062024-11-09T02:59:03.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133072024-11-09T02:59:03.030ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133082024-11-09T02:59:03.031ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133092024-11-09T02:59:03.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133102024-11-09T02:59:03.033ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
133112024-11-09T02:59:03.033ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133122024-11-09T02:59:03.033ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133132024-11-09T02:59:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
133142024-11-09T02:59:03.034ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
133152024-11-09T02:59:03.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
133162024-11-09T02:59:03.043ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133172024-11-09T02:59:03.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
133182024-11-09T02:59:03.045ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
133192024-11-09T02:59:03.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
133202024-11-09T02:59:03.048ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
133212024-11-09T02:59:03.048ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 34.36761ms iteration = 76 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
133222024-11-09T02:59:03.048ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1646, tv_nsec: 383565095 } })
133232024-11-09T02:59:03.048ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
133242024-11-09T02:59:03.052ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133252024-11-09T02:59:03.052ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133262024-11-09T02:59:03.054ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133272024-11-09T02:59:03.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133282024-11-09T02:59:03.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
133292024-11-09T02:59:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
133302024-11-09T02:59:03.059ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133312024-11-09T02:59:03.060ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 46.278417ms iteration = 26 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
133322024-11-09T02:59:03.061ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133332024-11-09T02:59:03.061ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
133342024-11-09T02:59:03.061ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133352024-11-09T02:59:03.061ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133362024-11-09T02:59:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
133372024-11-09T02:59:03.062ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
133382024-11-09T02:59:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
133392024-11-09T02:59:03.063ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133402024-11-09T02:59:03.063ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
133412024-11-09T02:59:03.063ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
133422024-11-09T02:59:03.063ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 50.250579ms iteration = 76 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
133432024-11-09T02:59:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
133442024-11-09T02:59:03.068ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133452024-11-09T02:59:03.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133462024-11-09T02:59:03.070ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 1 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
133472024-11-09T02:59:03.070ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 56.958657ms iteration = 26 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":1,"total_instances":0,"update_sagas_queued":0}
133482024-11-09T02:59:03.087ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133492024-11-09T02:59:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
133502024-11-09T02:59:03.090ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
133512024-11-09T02:59:03.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
133522024-11-09T02:59:03.092ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 78.89235ms iteration = 26 status = 0
133532024-11-09T02:59:03.097ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
133542024-11-09T02:59:03.097ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133552024-11-09T02:59:03.097ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffd71708-6cce-40eb-85f2-677ae1437fca", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
133562024-11-09T02:59:03.097ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133572024-11-09T02:59:03.099ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
133582024-11-09T02:59:03.099ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133592024-11-09T02:59:03.099ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133602024-11-09T02:59:03.099ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7f527b09-495c-4d52-9a66-27760c395e27", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
133612024-11-09T02:59:03.099ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133622024-11-09T02:59:03.100ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
133632024-11-09T02:59:03.109ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
133642024-11-09T02:59:03.109ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
133652024-11-09T02:59:03.109ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 95.464733ms iteration = 26 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
133662024-11-09T02:59:03.128ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
133672024-11-09T02:59:03.128ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
133682024-11-09T02:59:03.129ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4041afc6-4b6c-44e6-a351-68d2b846b93e", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
133692024-11-09T02:59:03.129ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
133702024-11-09T02:59:03.130ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
133712024-11-09T02:59:03.166ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 152.986142ms iteration = 29 status = {"physical_disks_added":0}
133722024-11-09T02:59:03.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133732024-11-09T02:59:03.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133742024-11-09T02:59:03.179ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 165.759546ms iteration = 26 status = {}
133752024-11-09T02:59:03.184ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
133762024-11-09T02:59:03.185ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd826b9c-b6d1-41c1-aa76-a992ee351919", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
133772024-11-09T02:59:03.187ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
133782024-11-09T02:59:03.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
133792024-11-09T02:59:03.191ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
133802024-11-09T02:59:03.191ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
133812024-11-09T02:59:03.192ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "80b83bd5-b142-4cec-9873-93c2fc1a27c0", "content-length": "372", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
133822024-11-09T02:59:03.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133832024-11-09T02:59:03.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133842024-11-09T02:59:03.196ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133852024-11-09T02:59:03.196ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 182.983312ms iteration = 26 status = null
133862024-11-09T02:59:03.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133872024-11-09T02:59:03.198ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133882024-11-09T02:59:03.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133892024-11-09T02:59:03.250ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
133902024-11-09T02:59:03.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
133912024-11-09T02:59:03.253ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
133922024-11-09T02:59:03.254ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
133932024-11-09T02:59:03.256ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
133942024-11-09T02:59:03.256ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
133952024-11-09T02:59:03.256ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7f428a08-6275-44c6-bf3a-10db6c32677c", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
133962024-11-09T02:59:03.256ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133972024-11-09T02:59:03.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
133982024-11-09T02:59:03.263ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
133992024-11-09T02:59:03.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134002024-11-09T02:59:03.269ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
134012024-11-09T02:59:03.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
134022024-11-09T02:59:03.273ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
134032024-11-09T02:59:03.273ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
134042024-11-09T02:59:03.274ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "633a7c91-3543-4286-a280-60bd1eff4979", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
134052024-11-09T02:59:03.275ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 261.963474ms iteration = 27 status = {}
134062024-11-09T02:59:03.279ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134072024-11-09T02:59:03.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134082024-11-09T02:59:03.282ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
134092024-11-09T02:59:03.282ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134102024-11-09T02:59:03.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134112024-11-09T02:59:03.296ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
134122024-11-09T02:59:03.297ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "318d47aa-b7cd-4309-84ae-61216f022af3", "content-length": "134", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
134132024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
134142024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
134152024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
134162024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
134172024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134182024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134192024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134202024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134212024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
134222024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
134232024-11-09T02:59:03.297ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
134242024-11-09T02:59:03.297ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134252024-11-09T02:59:03.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134262024-11-09T02:59:03.300ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
134272024-11-09T02:59:03.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "4aeefde4-b161-4491-926b-a59ff363feba", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
134282024-11-09T02:59:03.300ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
134292024-11-09T02:59:03.300ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ad1ae094-383c-4cf4-b2a6-607245b297af", "content-length": "52", "date": "Sat, 09 Nov 2024 02:59:02 GMT"} })
134302024-11-09T02:59:03.300ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
134312024-11-09T02:59:03.300ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
134322024-11-09T02:59:03.354ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
134332024-11-09T02:59:03.413ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6ee7b023-b8a0-4e96-90fc-1d9b655b337c", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
134342024-11-09T02:59:03.413ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
134352024-11-09T02:59:03.413ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
134362024-11-09T02:59:03.414ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "21b7165a-3956-4478-b378-4e68b7c35b58", "content-length": "682", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
134372024-11-09T02:59:03.414ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134382024-11-09T02:59:03.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134392024-11-09T02:59:03.414ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d8b3ba64-10a2-4f5f-9cfb-9ea1d51ffcf5", "content-length": "691", "date": "Sat, 09 Nov 2024 02:59:03 GMT"} })
134402024-11-09T02:59:03.414ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
134412024-11-09T02:59:03.414ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
134422024-11-09T02:59:03.414ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
134432024-11-09T02:59:03.415ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 402.056989ms iteration = 26 status = {}
134442024-11-09T02:59:03.418ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134452024-11-09T02:59:03.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134462024-11-09T02:59:03.421ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134472024-11-09T02:59:03.421ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134482024-11-09T02:59:03.423ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
134492024-11-09T02:59:03.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
134502024-11-09T02:59:03.430ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 416.951567ms iteration = 26 status = {}
134512024-11-09T02:59:05.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 5012f2e7-bebe-457b-88f4-8427729bede7 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134522024-11-09T02:59:05.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 5012f2e7-bebe-457b-88f4-8427729bede7 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134532024-11-09T02:59:05.149ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 3476 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 5012f2e7-bebe-457b-88f4-8427729bede7 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134542024-11-09T02:59:05.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2b387ce6-3094-437a-a773-a47b8722aa32 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134552024-11-09T02:59:05.150ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2b387ce6-3094-437a-a773-a47b8722aa32 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134562024-11-09T02:59:05.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2198 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 2b387ce6-3094-437a-a773-a47b8722aa32 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134572024-11-09T02:59:13.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 77 reason = Timeout
134582024-11-09T02:59:13.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134592024-11-09T02:59:13.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 77 reason = Timeout
134602024-11-09T02:59:13.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134612024-11-09T02:59:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134622024-11-09T02:59:13.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134632024-11-09T02:59:13.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134642024-11-09T02:59:13.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
134652024-11-09T02:59:13.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
134662024-11-09T02:59:13.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
134672024-11-09T02:59:13.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134682024-11-09T02:59:13.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134692024-11-09T02:59:13.048ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134702024-11-09T02:59:13.048ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134712024-11-09T02:59:13.072ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 58.746014ms iteration = 77 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
134722024-11-09T02:59:13.082ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
134732024-11-09T02:59:13.085ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
134742024-11-09T02:59:13.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
134752024-11-09T02:59:13.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
134762024-11-09T02:59:13.098ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
134772024-11-09T02:59:13.098ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 84.093369ms iteration = 77 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
134782024-11-09T02:59:15.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1278 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = a42d1af9-08c9-47d4-beac-733908fc6857 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
134792024-11-09T02:59:16.956ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33494
134802024-11-09T02:59:16.956ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33494 req_id = a2d25246-d97f-4655-8c08-167f8bea70f8 roles = RoleSet { roles: {} } uri = /metrics/producers
134812024-11-09T02:59:16.957ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33494 req_id = a2d25246-d97f-4655-8c08-167f8bea70f8 resource = Database result = Ok(()) uri = /metrics/producers
134822024-11-09T02:59:17.003ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2af5c33a-0969-4aa3-b944-8241cd51735a
134832024-11-09T02:59:17.003ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 46565 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33494 req_id = a2d25246-d97f-4655-8c08-167f8bea70f8 response_code = 201 uri = /metrics/producers
134842024-11-09T02:59:18.665ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50286
134852024-11-09T02:59:18.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50286 req_id = c754d533-c75b-4787-9ca4-9fb01400a905 roles = RoleSet { roles: {} } uri = /metrics/producers
134862024-11-09T02:59:18.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50286 req_id = c754d533-c75b-4787-9ca4-9fb01400a905 resource = Database result = Ok(()) uri = /metrics/producers
134872024-11-09T02:59:18.700ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = e7a6aff4-8a9d-474e-9121-e7dbcbb9a41f
134882024-11-09T02:59:18.700ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 35153 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50286 req_id = c754d533-c75b-4787-9ca4-9fb01400a905 response_code = 201 uri = /metrics/producers
134892024-11-09T02:59:20.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 1e965ae3-f914-4596-8c1f-45b81f962b0c roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134902024-11-09T02:59:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 1e965ae3-f914-4596-8c1f-45b81f962b0c resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134912024-11-09T02:59:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2727 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 1e965ae3-f914-4596-8c1f-45b81f962b0c response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
134922024-11-09T02:59:20.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = b3898dd7-65ba-4b09-8351-d282d5b285c1 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134932024-11-09T02:59:20.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = b3898dd7-65ba-4b09-8351-d282d5b285c1 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134942024-11-09T02:59:20.150ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1585 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = b3898dd7-65ba-4b09-8351-d282d5b285c1 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
134952024-11-09T02:59:22.604ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:52105
134962024-11-09T02:59:22.605ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52105 req_id = 9c0c50a6-7d91-4706-89db-57b2c2a16318 roles = RoleSet { roles: {} } uri = /metrics/producers
134972024-11-09T02:59:22.605ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52105 req_id = 9c0c50a6-7d91-4706-89db-57b2c2a16318 resource = Database result = Ok(()) uri = /metrics/producers
134982024-11-09T02:59:22.647ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 2f0a30af-958d-4bf8-b248-aa00a55250d3
134992024-11-09T02:59:22.648ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 43049 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:52105 req_id = 9c0c50a6-7d91-4706-89db-57b2c2a16318 response_code = 201 uri = /metrics/producers
135002024-11-09T02:59:22.831ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:60171
135012024-11-09T02:59:22.831ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60171 req_id = a332b687-b6b0-4f6e-9f40-135ecd3aa71a roles = RoleSet { roles: {} } uri = /metrics/producers
135022024-11-09T02:59:22.832ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60171 req_id = a332b687-b6b0-4f6e-9f40-135ecd3aa71a resource = Database result = Ok(()) uri = /metrics/producers
135032024-11-09T02:59:22.842ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 1608900a-b360-41b1-81ba-2f7429428b85
135042024-11-09T02:59:22.842ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 11103 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:60171 req_id = a332b687-b6b0-4f6e-9f40-135ecd3aa71a response_code = 201 uri = /metrics/producers
135052024-11-09T02:59:23.013ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 78 reason = Timeout
135062024-11-09T02:59:23.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 78 reason = Timeout
135072024-11-09T02:59:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135082024-11-09T02:59:23.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135092024-11-09T02:59:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135102024-11-09T02:59:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135112024-11-09T02:59:23.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135122024-11-09T02:59:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
135132024-11-09T02:59:23.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135142024-11-09T02:59:23.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135152024-11-09T02:59:23.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135162024-11-09T02:59:23.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135172024-11-09T02:59:23.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
135182024-11-09T02:59:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
135192024-11-09T02:59:23.025ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135202024-11-09T02:59:23.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
135212024-11-09T02:59:23.037ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
135222024-11-09T02:59:23.037ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.420874ms iteration = 78 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
135232024-11-09T02:59:23.044ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135242024-11-09T02:59:23.044ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
135252024-11-09T02:59:23.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.049922ms iteration = 78 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
135262024-11-09T02:59:28.032ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:53582
135272024-11-09T02:59:28.032ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53582 req_id = ba2323b3-5ed5-4da3-b755-09025ce3bae5 roles = RoleSet { roles: {} } uri = /metrics/producers
135282024-11-09T02:59:28.033ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53582 req_id = ba2323b3-5ed5-4da3-b755-09025ce3bae5 resource = Database result = Ok(()) uri = /metrics/producers
135292024-11-09T02:59:28.070ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = d420d83c-5432-42e4-aaba-2a651646b168
135302024-11-09T02:59:28.070ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 37560 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:53582 req_id = ba2323b3-5ed5-4da3-b755-09025ce3bae5 response_code = 201 uri = /metrics/producers
135312024-11-09T02:59:30.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1844 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 211a03e3-469a-43c4-a7d2-343be01bedd8 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
135322024-11-09T02:59:32.208ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:49377
135332024-11-09T02:59:32.208ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49377 req_id = 8fcb890d-1502-4ec7-b418-59377e5def91 roles = RoleSet { roles: {} } uri = /metrics/producers
135342024-11-09T02:59:32.208ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49377 req_id = 8fcb890d-1502-4ec7-b418-59377e5def91 resource = Database result = Ok(()) uri = /metrics/producers
135352024-11-09T02:59:32.247ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = f032ba4a-ac68-41c0-a068-00d3371df648
135362024-11-09T02:59:32.247ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 39572 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:49377 req_id = 8fcb890d-1502-4ec7-b418-59377e5def91 response_code = 201 uri = /metrics/producers
135372024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 16 reason = Timeout
135382024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 15 reason = Timeout
135392024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
135402024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
135412024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 27 reason = Timeout
135422024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 27 reason = Timeout
135432024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
135442024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
135452024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 79 reason = Timeout
135462024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 27 reason = Timeout
135472024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
135482024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
135492024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
135502024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 14 reason = Timeout
135512024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
135522024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 27 reason = Timeout
135532024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
135542024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 27 reason = Timeout
135552024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 28 reason = Timeout
135562024-11-09T02:59:33.014ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
135572024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 15 reason = Timeout
135582024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
135592024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 15 reason = Timeout
135602024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 14 reason = Timeout
135612024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
135622024-11-09T02:59:33.014ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:49:33.014779560 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
135632024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 15 reason = Timeout
135642024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
135652024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
135662024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
135672024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 15 reason = Timeout
135682024-11-09T02:59:33.014ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
135692024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.951\u{b5}s iteration = 15 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
135702024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 16 reason = Timeout
135712024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 27 reason = Timeout
135722024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
135732024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 14 reason = Timeout
135742024-11-09T02:59:33.014ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
135752024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 27 reason = Timeout
135762024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
135772024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
135782024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 27 reason = Timeout
135792024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
135802024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 79 reason = Timeout
135812024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 15 reason = Timeout
135822024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
135832024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 30 reason = Timeout
135842024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
135852024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 27 reason = Timeout
135862024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
135872024-11-09T02:59:33.014ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 27 reason = Timeout
135882024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.42\u{b5}s iteration = 27 status = {"errors":[],"garbage_collect_requested":[]}
135892024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 27 reason = Timeout
135902024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 4.349\u{b5}s iteration = 27 status = {"errors":[],"records_set_to_done":[]}
135912024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 14 reason = Timeout
135922024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 27 reason = Timeout
135932024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
135942024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 27 reason = Timeout
135952024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 15.96\u{b5}s iteration = 27 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
135962024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.6\u{b5}s iteration = 27 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
135972024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
135982024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
135992024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 14 reason = Timeout
136002024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
136012024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
136022024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136032024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136042024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136052024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136062024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
136072024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136082024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
136092024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136102024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
136112024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136122024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
136132024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136142024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
136152024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
136162024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136172024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
136182024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
136192024-11-09T02:59:33.015ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 350727616 } })
136202024-11-09T02:59:33.015ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 350785928 } })
136212024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
136222024-11-09T02:59:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.040692ms iteration = 15 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
136232024-11-09T02:59:33.016ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
136242024-11-09T02:59:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.317337ms iteration = 15 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
136252024-11-09T02:59:33.016ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
136262024-11-09T02:59:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
136272024-11-09T02:59:33.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.269428ms iteration = 27 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
136282024-11-09T02:59:33.018ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
136292024-11-09T02:59:33.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
136302024-11-09T02:59:33.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136312024-11-09T02:59:33.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136322024-11-09T02:59:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
136332024-11-09T02:59:33.021ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
136342024-11-09T02:59:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
136352024-11-09T02:59:33.022ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
136362024-11-09T02:59:33.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
136372024-11-09T02:59:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
136382024-11-09T02:59:33.023ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:49:33.014779560 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
136392024-11-09T02:59:33.023ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 8.367333ms iteration = 14 status = {"expiration":"2024-11-09T02:49:33.014779560Z","pruned":[]}
136402024-11-09T02:59:33.025ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136412024-11-09T02:59:33.027ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 12.033558ms iteration = 14 status = {"errors":[],"found_port_ok":[]}
136422024-11-09T02:59:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
136432024-11-09T02:59:33.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136442024-11-09T02:59:33.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136452024-11-09T02:59:33.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 364855339 } })
136462024-11-09T02:59:33.030ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
136472024-11-09T02:59:33.032ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 368030894 } })
136482024-11-09T02:59:33.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
136492024-11-09T02:59:33.033ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136502024-11-09T02:59:33.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1676, tv_nsec: 369035305 } })
136512024-11-09T02:59:33.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136522024-11-09T02:59:33.034ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
136532024-11-09T02:59:33.036ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136542024-11-09T02:59:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
136552024-11-09T02:59:33.040ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
136562024-11-09T02:59:33.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
136572024-11-09T02:59:33.066ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136582024-11-09T02:59:33.067ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
136592024-11-09T02:59:33.068ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
136602024-11-09T02:59:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
136612024-11-09T02:59:33.070ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
136622024-11-09T02:59:33.070ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
136632024-11-09T02:59:33.071ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136642024-11-09T02:59:33.071ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136652024-11-09T02:59:33.071ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
136662024-11-09T02:59:33.071ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136672024-11-09T02:59:33.071ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136682024-11-09T02:59:33.073ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
136692024-11-09T02:59:33.073ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136702024-11-09T02:59:33.073ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136712024-11-09T02:59:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136722024-11-09T02:59:33.074ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
136732024-11-09T02:59:33.074ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
136742024-11-09T02:59:33.076ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136752024-11-09T02:59:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
136762024-11-09T02:59:33.078ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136772024-11-09T02:59:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136782024-11-09T02:59:33.078ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136792024-11-09T02:59:33.081ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
136802024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
136812024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
136822024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
136832024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
136842024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
136852024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136862024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136872024-11-09T02:59:33.081ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136882024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
136892024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
136902024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
136912024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
136922024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 69.460645ms iteration = 27 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
136932024-11-09T02:59:33.084ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
136942024-11-09T02:59:33.085ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
136952024-11-09T02:59:33.085ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
136962024-11-09T02:59:33.085ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
136972024-11-09T02:59:33.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
136982024-11-09T02:59:33.085ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
136992024-11-09T02:59:33.087ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137002024-11-09T02:59:33.087ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137012024-11-09T02:59:33.089ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
137022024-11-09T02:59:33.089ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
137032024-11-09T02:59:33.089ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.143243ms iteration = 14 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
137042024-11-09T02:59:33.089ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137052024-11-09T02:59:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
137062024-11-09T02:59:33.090ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
137072024-11-09T02:59:33.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
137082024-11-09T02:59:33.091ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
137092024-11-09T02:59:33.091ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
137102024-11-09T02:59:33.091ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
137112024-11-09T02:59:33.104ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
137122024-11-09T02:59:33.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.248255ms iteration = 79 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
137132024-11-09T02:59:33.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
137142024-11-09T02:59:33.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
137152024-11-09T02:59:33.109ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
137162024-11-09T02:59:33.109ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
137172024-11-09T02:59:33.109ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
137182024-11-09T02:59:33.109ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137192024-11-09T02:59:33.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137202024-11-09T02:59:33.111ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.459863ms iteration = 79 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
137212024-11-09T02:59:33.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137222024-11-09T02:59:33.111ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
137232024-11-09T02:59:33.111ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
137242024-11-09T02:59:33.111ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 97.148898ms iteration = 27 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
137252024-11-09T02:59:33.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137262024-11-09T02:59:33.112ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
137272024-11-09T02:59:33.112ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 98.014316ms iteration = 27 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
137282024-11-09T02:59:33.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137292024-11-09T02:59:33.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137302024-11-09T02:59:33.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137312024-11-09T02:59:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137322024-11-09T02:59:33.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137332024-11-09T02:59:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137342024-11-09T02:59:33.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137352024-11-09T02:59:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
137362024-11-09T02:59:33.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
137372024-11-09T02:59:33.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
137382024-11-09T02:59:33.123ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
137392024-11-09T02:59:33.123ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
137402024-11-09T02:59:33.123ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 109.028903ms iteration = 14 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
137412024-11-09T02:59:33.124ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137422024-11-09T02:59:33.124ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 110.024584ms iteration = 27 status = 0
137432024-11-09T02:59:33.125ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
137442024-11-09T02:59:33.125ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
137452024-11-09T02:59:33.125ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
137462024-11-09T02:59:33.125ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137472024-11-09T02:59:33.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137482024-11-09T02:59:33.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137492024-11-09T02:59:33.128ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
137502024-11-09T02:59:33.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137512024-11-09T02:59:33.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137522024-11-09T02:59:33.130ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137532024-11-09T02:59:33.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137542024-11-09T02:59:33.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
137552024-11-09T02:59:33.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137562024-11-09T02:59:33.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137572024-11-09T02:59:33.133ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137582024-11-09T02:59:33.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
137592024-11-09T02:59:33.135ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
137602024-11-09T02:59:33.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
137612024-11-09T02:59:33.163ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
137622024-11-09T02:59:33.163ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137632024-11-09T02:59:33.163ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c7e06bf-b1c4-40f0-986b-39b6faabe231", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
137642024-11-09T02:59:33.163ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137652024-11-09T02:59:33.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
137662024-11-09T02:59:33.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
137672024-11-09T02:59:33.166ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
137682024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
137692024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
137702024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137712024-11-09T02:59:33.188ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.72654ms iteration = 30 status = {"physical_disks_added":0}
137722024-11-09T02:59:33.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137732024-11-09T02:59:33.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
137742024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
137752024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
137762024-11-09T02:59:33.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
137772024-11-09T02:59:33.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
137782024-11-09T02:59:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
137792024-11-09T02:59:33.196ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
137802024-11-09T02:59:33.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
137812024-11-09T02:59:33.199ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
137822024-11-09T02:59:33.199ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
137832024-11-09T02:59:33.199ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
137842024-11-09T02:59:33.199ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 184.470192ms iteration = 15 status = {"generation":2}
137852024-11-09T02:59:33.204ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
137862024-11-09T02:59:33.204ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 189.649259ms iteration = 15 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
137872024-11-09T02:59:33.224ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
137882024-11-09T02:59:33.224ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137892024-11-09T02:59:33.225ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "98dd56fe-c75a-4907-8bed-9dd3086ed754", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
137902024-11-09T02:59:33.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137912024-11-09T02:59:33.229ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
137922024-11-09T02:59:33.244ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
137932024-11-09T02:59:33.244ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
137942024-11-09T02:59:33.245ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "50f611e6-e056-4ce0-867a-eeed08684a67", "content-length": "26", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
137952024-11-09T02:59:33.245ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
137962024-11-09T02:59:33.246ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
137972024-11-09T02:59:33.259ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
137982024-11-09T02:59:33.259ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 244.518063ms iteration = 14 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
137992024-11-09T02:59:33.259ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138002024-11-09T02:59:33.264ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
138012024-11-09T02:59:33.264ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
138022024-11-09T02:59:33.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
138032024-11-09T02:59:33.267ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
138042024-11-09T02:59:33.267ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
138052024-11-09T02:59:33.267ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
138062024-11-09T02:59:33.267ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 252.62037ms iteration = 15 status = {"generation":1}
138072024-11-09T02:59:33.294ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
138082024-11-09T02:59:33.309ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138092024-11-09T02:59:33.309ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138102024-11-09T02:59:33.311ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138112024-11-09T02:59:33.314ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138122024-11-09T02:59:33.315ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138132024-11-09T02:59:33.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138142024-11-09T02:59:33.317ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
138152024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
138162024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
138172024-11-09T02:59:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
138182024-11-09T02:59:33.341ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
138192024-11-09T02:59:33.412ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
138202024-11-09T02:59:33.412ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138212024-11-09T02:59:33.412ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b63580d4-0104-4c68-947e-4b10f69b125e", "content-length": "372", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138222024-11-09T02:59:33.412ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138232024-11-09T02:59:33.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138242024-11-09T02:59:33.429ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 414.665629ms iteration = 27 status = {}
138252024-11-09T02:59:33.433ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
138262024-11-09T02:59:33.433ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
138272024-11-09T02:59:33.433ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "c2e4c728-2827-49f1-9a73-38fd719dbeda", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138282024-11-09T02:59:33.433ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138292024-11-09T02:59:33.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138302024-11-09T02:59:33.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138312024-11-09T02:59:33.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138322024-11-09T02:59:33.440ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
138332024-11-09T02:59:33.440ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
138342024-11-09T02:59:33.440ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "7aa545ec-9afb-481a-9e56-35bbc88a07b9", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:32 GMT"} })
138352024-11-09T02:59:33.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
138362024-11-09T02:59:33.442ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
138372024-11-09T02:59:33.442ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
138382024-11-09T02:59:33.443ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
138392024-11-09T02:59:33.443ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
138402024-11-09T02:59:33.443ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "743f1b03-0786-4937-a85a-2244d96cb760", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138412024-11-09T02:59:33.445ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 430.423725ms iteration = 27 status = null
138422024-11-09T02:59:33.445ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 430.947625ms iteration = 28 status = {}
138432024-11-09T02:59:33.559ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
138442024-11-09T02:59:33.592ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
138452024-11-09T02:59:33.592ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "2afdd075-f577-4ca1-b095-449c3648f830", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138462024-11-09T02:59:33.592ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138472024-11-09T02:59:33.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "45a5852f-c65d-4a89-9118-57924b7ce2b6", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138482024-11-09T02:59:33.594ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138492024-11-09T02:59:33.596ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
138502024-11-09T02:59:33.596ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 581.423165ms iteration = 16 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
138512024-11-09T02:59:33.604ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
138522024-11-09T02:59:33.605ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "484c49be-6054-495a-99d4-0f3bd6f9cf84", "content-length": "691", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138532024-11-09T02:59:33.605ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
138542024-11-09T02:59:33.605ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
138552024-11-09T02:59:33.605ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
138562024-11-09T02:59:33.606ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 592.017284ms iteration = 27 status = {}
138572024-11-09T02:59:33.652ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138582024-11-09T02:59:33.652ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138592024-11-09T02:59:33.653ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
138602024-11-09T02:59:33.653ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a9c063bb-3e34-4c23-a336-56aa62957b75", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138612024-11-09T02:59:33.653ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138622024-11-09T02:59:33.653ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
138632024-11-09T02:59:33.653ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138642024-11-09T02:59:33.653ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138652024-11-09T02:59:33.655ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "c398fecb-101c-42fd-9016-9404b6f8bdf9", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138662024-11-09T02:59:33.655ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138672024-11-09T02:59:33.657ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "b161e7a1-fd0f-492b-acb2-7502962b5b8d", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138682024-11-09T02:59:33.657ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138692024-11-09T02:59:33.659ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
138702024-11-09T02:59:33.659ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 645.262325ms iteration = 16 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
138712024-11-09T02:59:33.663ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
138722024-11-09T02:59:33.664ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "3f582302-9ca3-42da-b6e1-28bbe441866b", "content-length": "134", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138732024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
138742024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
138752024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
138762024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
138772024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138782024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138792024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138802024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
138812024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
138822024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
138832024-11-09T02:59:33.664ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
138842024-11-09T02:59:33.664ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138852024-11-09T02:59:33.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138862024-11-09T02:59:33.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
138872024-11-09T02:59:33.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8dd6a2b3-342e-4dd0-a1c5-1361aacc082d", "content-length": "2", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138882024-11-09T02:59:33.667ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
138892024-11-09T02:59:33.667ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e962bd8-a837-496d-b4dc-e11bcf815d4a", "content-length": "52", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138902024-11-09T02:59:33.667ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
138912024-11-09T02:59:33.667ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
138922024-11-09T02:59:33.883ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "14ce67e4-0426-4bc6-9e4a-6f4d6a81f94d", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138932024-11-09T02:59:33.883ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
138942024-11-09T02:59:33.883ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
138952024-11-09T02:59:33.883ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "a670f808-417d-4398-9527-8f42d117cde2", "content-length": "682", "date": "Sat, 09 Nov 2024 02:59:33 GMT"} })
138962024-11-09T02:59:33.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138972024-11-09T02:59:33.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
138982024-11-09T02:59:33.887ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
138992024-11-09T02:59:33.887ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139002024-11-09T02:59:33.890ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139012024-11-09T02:59:33.890ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139022024-11-09T02:59:33.892ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139032024-11-09T02:59:33.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139042024-11-09T02:59:33.899ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 885.045551ms iteration = 27 status = {}
139052024-11-09T02:59:40.223ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
139062024-11-09T02:59:40.223ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
139072024-11-09T02:59:40.254ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
139082024-11-09T02:59:40.254ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:1105 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:33352
139092024-11-09T02:59:40.254ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33352 req_id = b339c07d-1cd5-4a60-be2d-3828f86bed68 roles = RoleSet { roles: {} } uri = /metrics/producers
139102024-11-09T02:59:40.255ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33352 req_id = b339c07d-1cd5-4a60-be2d-3828f86bed68 resource = Database result = Ok(()) uri = /metrics/producers
139112024-11-09T02:59:40.299ZINFOnexus: assigned collector to new producer collector_id = be0f5b06-b4d4-43f1-a81e-d1635992ea60 file = nexus/src/app/oximeter.rs:76 producer_id = 0339f029-6c8d-4b23-83cc-6885965f777d
139122024-11-09T02:59:40.299ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 44291 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:33352 req_id = b339c07d-1cd5-4a60-be2d-3828f86bed68 response_code = 201 uri = /metrics/producers
139132024-11-09T02:59:40.299ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "b339c07d-1cd5-4a60-be2d-3828f86bed68", "content-length": "41", "date": "Sat, 09 Nov 2024 02:59:40 GMT"} })
139142024-11-09T02:59:40.301ZDEBGnexus (producer-registration-task): registered with nexus successfully
139152024-11-09T02:59:40.301ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
139162024-11-09T02:59:43.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 80 reason = Timeout
139172024-11-09T02:59:43.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 80 reason = Timeout
139182024-11-09T02:59:43.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139192024-11-09T02:59:43.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139202024-11-09T02:59:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139212024-11-09T02:59:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139222024-11-09T02:59:43.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139232024-11-09T02:59:43.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139242024-11-09T02:59:43.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139252024-11-09T02:59:43.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139262024-11-09T02:59:43.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139272024-11-09T02:59:43.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139282024-11-09T02:59:43.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139292024-11-09T02:59:43.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
139302024-11-09T02:59:43.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139312024-11-09T02:59:43.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139322024-11-09T02:59:43.038ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
139332024-11-09T02:59:43.038ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.032127ms iteration = 80 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
139342024-11-09T02:59:43.043ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139352024-11-09T02:59:43.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139362024-11-09T02:59:43.045ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.47786ms iteration = 80 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139372024-11-09T02:59:45.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1017 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = e5b12296-7901-40c6-a3f8-8fffc90418f8 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
139382024-11-09T02:59:53.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 81 reason = Timeout
139392024-11-09T02:59:53.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 81 reason = Timeout
139402024-11-09T02:59:53.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139412024-11-09T02:59:53.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139422024-11-09T02:59:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139432024-11-09T02:59:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139442024-11-09T02:59:53.016ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139452024-11-09T02:59:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
139462024-11-09T02:59:53.019ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139472024-11-09T02:59:53.019ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139482024-11-09T02:59:53.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139492024-11-09T02:59:53.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139502024-11-09T02:59:53.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
139512024-11-09T02:59:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
139522024-11-09T02:59:53.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139532024-11-09T02:59:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139542024-11-09T02:59:53.036ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
139552024-11-09T02:59:53.036ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.834872ms iteration = 81 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
139562024-11-09T02:59:53.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139572024-11-09T02:59:53.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139582024-11-09T02:59:53.043ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.421017ms iteration = 81 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
139592024-11-09T03:00:00.155ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1208 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 6b310dff-1934-425b-828e-dcf4a9584bd7 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
139602024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 28 reason = Timeout
139612024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 28 reason = Timeout
139622024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
139632024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
139642024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 29 reason = Timeout
139652024-11-09T03:00:03.014ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
139662024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
139672024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 31 reason = Timeout
139682024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 28 reason = Timeout
139692024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 28 reason = Timeout
139702024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
139712024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
139722024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 82 reason = Timeout
139732024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
139742024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 28 reason = Timeout
139752024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 28 reason = Timeout
139762024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
139772024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
139782024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
139792024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 28 reason = Timeout
139802024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 28 reason = Timeout
139812024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
139822024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 82 reason = Timeout
139832024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
139842024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
139852024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 28 reason = Timeout
139862024-11-09T03:00:03.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
139872024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
139882024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
139892024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
139902024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
139912024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
139922024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
139932024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
139942024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
139952024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
139962024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
139972024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
139982024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
139992024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 28 reason = Timeout
140002024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 28 reason = Timeout
140012024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.61\u{b5}s iteration = 28 status = {"errors":[],"records_set_to_done":[]}
140022024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 15.341\u{b5}s iteration = 28 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
140032024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 28 reason = Timeout
140042024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 28 reason = Timeout
140052024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 2.99\u{b5}s iteration = 28 status = {"errors":[],"garbage_collect_requested":[]}
140062024-11-09T03:00:03.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 3.75\u{b5}s iteration = 28 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
140072024-11-09T03:00:03.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140082024-11-09T03:00:03.018ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 353137996 } })
140092024-11-09T03:00:03.018ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
140102024-11-09T03:00:03.018ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.105765ms iteration = 28 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
140112024-11-09T03:00:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140122024-11-09T03:00:03.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140132024-11-09T03:00:03.020ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140142024-11-09T03:00:03.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140152024-11-09T03:00:03.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140162024-11-09T03:00:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140172024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
140182024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140192024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
140202024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
140212024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140222024-11-09T03:00:03.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
140232024-11-09T03:00:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
140242024-11-09T03:00:03.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140252024-11-09T03:00:03.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140262024-11-09T03:00:03.024ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140272024-11-09T03:00:03.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140282024-11-09T03:00:03.026ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 361071760 } })
140292024-11-09T03:00:03.026ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
140302024-11-09T03:00:03.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140312024-11-09T03:00:03.026ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140322024-11-09T03:00:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140332024-11-09T03:00:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
140342024-11-09T03:00:03.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
140352024-11-09T03:00:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
140362024-11-09T03:00:03.028ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140372024-11-09T03:00:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140382024-11-09T03:00:03.028ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140392024-11-09T03:00:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140402024-11-09T03:00:03.029ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140412024-11-09T03:00:03.029ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1706, tv_nsec: 364500511 } })
140422024-11-09T03:00:03.029ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
140432024-11-09T03:00:03.030ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
140442024-11-09T03:00:03.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140452024-11-09T03:00:03.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140462024-11-09T03:00:03.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140472024-11-09T03:00:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140482024-11-09T03:00:03.032ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140492024-11-09T03:00:03.035ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
140502024-11-09T03:00:03.035ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
140512024-11-09T03:00:03.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
140522024-11-09T03:00:03.057ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
140532024-11-09T03:00:03.058ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140542024-11-09T03:00:03.058ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
140552024-11-09T03:00:03.058ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140562024-11-09T03:00:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
140572024-11-09T03:00:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140582024-11-09T03:00:03.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
140592024-11-09T03:00:03.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
140602024-11-09T03:00:03.065ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
140612024-11-09T03:00:03.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140622024-11-09T03:00:03.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140632024-11-09T03:00:03.067ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
140642024-11-09T03:00:03.067ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
140652024-11-09T03:00:03.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
140662024-11-09T03:00:03.073ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
140672024-11-09T03:00:03.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 59.239014ms iteration = 28 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
140682024-11-09T03:00:03.104ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
140692024-11-09T03:00:03.104ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140702024-11-09T03:00:03.104ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0e29a424-20fb-4405-bb15-148e8b727914", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140712024-11-09T03:00:03.104ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140722024-11-09T03:00:03.107ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140732024-11-09T03:00:03.120ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
140742024-11-09T03:00:03.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
140752024-11-09T03:00:03.132ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
140762024-11-09T03:00:03.132ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140772024-11-09T03:00:03.132ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5972cc78-40aa-4c58-a29b-d6d444f03e43", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140782024-11-09T03:00:03.132ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140792024-11-09T03:00:03.135ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
140802024-11-09T03:00:03.141ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
140812024-11-09T03:00:03.141ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
140822024-11-09T03:00:03.141ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f63301ea-3665-4490-ac12-a5c48b22f14a", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140832024-11-09T03:00:03.141ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
140842024-11-09T03:00:03.142ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
140852024-11-09T03:00:03.142ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
140862024-11-09T03:00:03.142ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b61f0f17-6d7d-4c53-a178-091a7db0f4ed", "content-length": "372", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
140872024-11-09T03:00:03.142ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
140882024-11-09T03:00:03.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
140892024-11-09T03:00:03.144ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
140902024-11-09T03:00:03.144ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.871284ms iteration = 82 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
140912024-11-09T03:00:03.145ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140922024-11-09T03:00:03.145ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
140932024-11-09T03:00:03.145ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
140942024-11-09T03:00:03.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
140952024-11-09T03:00:03.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
140962024-11-09T03:00:03.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
140972024-11-09T03:00:03.148ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
140982024-11-09T03:00:03.148ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
140992024-11-09T03:00:03.148ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.957359ms iteration = 28 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
141002024-11-09T03:00:03.149ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141012024-11-09T03:00:03.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
141022024-11-09T03:00:03.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
141032024-11-09T03:00:03.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
141042024-11-09T03:00:03.154ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 139.82867ms iteration = 28 status = 0
141052024-11-09T03:00:03.157ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
141062024-11-09T03:00:03.157ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 142.536345ms iteration = 82 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
141072024-11-09T03:00:03.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 178.242874ms iteration = 28 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
141082024-11-09T03:00:03.213ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
141092024-11-09T03:00:03.213ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "a301910d-e738-4b67-bdcf-b3c5abe1c71c", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
141102024-11-09T03:00:03.218ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
141112024-11-09T03:00:03.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
141122024-11-09T03:00:03.225ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
141132024-11-09T03:00:03.225ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
141142024-11-09T03:00:03.225ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 210.859108ms iteration = 28 status = null
141152024-11-09T03:00:03.225ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cea6430f-50ec-4773-88e9-97b991d86151", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
141162024-11-09T03:00:03.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141172024-11-09T03:00:03.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141182024-11-09T03:00:03.233ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141192024-11-09T03:00:03.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141202024-11-09T03:00:03.236ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.369255ms iteration = 28 status = {}
141212024-11-09T03:00:03.237ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
141222024-11-09T03:00:03.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
141232024-11-09T03:00:03.240ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
141242024-11-09T03:00:03.240ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
141252024-11-09T03:00:03.241ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "52aa1e0e-0af7-4cd0-9ac8-e6cbf8b8406e", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
141262024-11-09T03:00:03.242ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 228.305658ms iteration = 29 status = {}
141272024-11-09T03:00:03.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141282024-11-09T03:00:03.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141292024-11-09T03:00:03.269ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141302024-11-09T03:00:03.270ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 255.585493ms iteration = 31 status = {"physical_disks_added":0}
141312024-11-09T03:00:03.271ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141322024-11-09T03:00:03.271ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141332024-11-09T03:00:03.271ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141342024-11-09T03:00:03.273ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141352024-11-09T03:00:03.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
141362024-11-09T03:00:03.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
141372024-11-09T03:00:03.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
141382024-11-09T03:00:03.304ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141392024-11-09T03:00:03.304ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141402024-11-09T03:00:03.306ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
141412024-11-09T03:00:03.306ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141422024-11-09T03:00:03.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141432024-11-09T03:00:03.316ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
141442024-11-09T03:00:03.317ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ae98060f-26e4-40fc-a7ae-af7a9ca7aa5e", "content-length": "134", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
141452024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
141462024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
141472024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
141482024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
141492024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141502024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141512024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141522024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141532024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
141542024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
141552024-11-09T03:00:03.317ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
141562024-11-09T03:00:03.317ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141572024-11-09T03:00:03.318ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141582024-11-09T03:00:03.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
141592024-11-09T03:00:03.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "3a63fb9f-ce37-462c-9a99-8828d06be50d", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
141602024-11-09T03:00:03.319ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
141612024-11-09T03:00:03.319ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "c73b60e6-73ec-4b63-9c71-17867dfcf83b", "content-length": "52", "date": "Sat, 09 Nov 2024 03:00:02 GMT"} })
141622024-11-09T03:00:03.319ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
141632024-11-09T03:00:03.319ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
141642024-11-09T03:00:03.381ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
141652024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "d090517d-9981-4b61-9365-7f0bec951ee0", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
141662024-11-09T03:00:03.443ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
141672024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
141682024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "337cf21b-554c-479f-a227-bc9c5ecfd63d", "content-length": "682", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
141692024-11-09T03:00:03.443ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141702024-11-09T03:00:03.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141712024-11-09T03:00:03.448ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141722024-11-09T03:00:03.448ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141732024-11-09T03:00:03.448ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "ffb8d701-82c7-44fe-88dd-a54b986737db", "content-length": "691", "date": "Sat, 09 Nov 2024 03:00:03 GMT"} })
141742024-11-09T03:00:03.449ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
141752024-11-09T03:00:03.449ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
141762024-11-09T03:00:03.449ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
141772024-11-09T03:00:03.451ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.510471ms iteration = 28 status = {}
141782024-11-09T03:00:03.452ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141792024-11-09T03:00:03.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141802024-11-09T03:00:03.454ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
141812024-11-09T03:00:03.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
141822024-11-09T03:00:03.460ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 446.295242ms iteration = 28 status = {}
141832024-11-09T03:00:13.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 83 reason = Timeout
141842024-11-09T03:00:13.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141852024-11-09T03:00:13.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 83 reason = Timeout
141862024-11-09T03:00:13.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141872024-11-09T03:00:13.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141882024-11-09T03:00:13.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141892024-11-09T03:00:13.016ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
141902024-11-09T03:00:13.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
141912024-11-09T03:00:13.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141922024-11-09T03:00:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
141932024-11-09T03:00:13.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141942024-11-09T03:00:13.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141952024-11-09T03:00:13.023ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
141962024-11-09T03:00:13.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
141972024-11-09T03:00:13.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
141982024-11-09T03:00:13.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
141992024-11-09T03:00:13.027ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142002024-11-09T03:00:13.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142012024-11-09T03:00:13.039ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
142022024-11-09T03:00:13.039ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.63244ms iteration = 83 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
142032024-11-09T03:00:13.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.45325ms iteration = 83 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142042024-11-09T03:00:15.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1061 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 77362412-3dc5-416b-9c5c-1ac0de16a68d response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
142052024-11-09T03:00:20.146ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 33884df3-99a6-494c-927e-865ee3bf4a1a roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
142062024-11-09T03:00:20.146ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 33884df3-99a6-494c-927e-865ee3bf4a1a resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
142072024-11-09T03:00:20.148ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2866 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = 33884df3-99a6-494c-927e-865ee3bf4a1a response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?sort_by=id_ascending
142082024-11-09T03:00:20.149ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = eee11d12-718b-4939-b7ad-830a08e20416 roles = RoleSet { roles: {} } uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
142092024-11-09T03:00:20.149ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = eee11d12-718b-4939-b7ad-830a08e20416 resource = Database result = Ok(()) uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
142102024-11-09T03:00:20.151ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 2187 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:57597 req_id = eee11d12-718b-4939-b7ad-830a08e20416 response_code = 200 uri = /metrics/collectors/be0f5b06-b4d4-43f1-a81e-d1635992ea60/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmMDMyYmE0YS1hYzY4LTQxYzAtYTA2OC0wMGQzMzcxZGY2NDgifX0%3D
142112024-11-09T03:00:23.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 84 reason = Timeout
142122024-11-09T03:00:23.014ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142132024-11-09T03:00:23.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 84 reason = Timeout
142142024-11-09T03:00:23.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142152024-11-09T03:00:23.014ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142162024-11-09T03:00:23.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142172024-11-09T03:00:23.017ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142182024-11-09T03:00:23.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
142192024-11-09T03:00:23.019ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 5.539524ms iteration = 84 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
142202024-11-09T03:00:23.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142212024-11-09T03:00:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
142222024-11-09T03:00:23.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142232024-11-09T03:00:23.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142242024-11-09T03:00:23.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142252024-11-09T03:00:23.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142262024-11-09T03:00:23.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
142272024-11-09T03:00:23.053ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
142282024-11-09T03:00:23.053ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142292024-11-09T03:00:23.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
142302024-11-09T03:00:23.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
142312024-11-09T03:00:23.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 51.191298ms iteration = 84 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
142322024-11-09T03:00:30.153ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1829 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 427756f9-9382-42bb-822d-4060c510f452 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
142332024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 30 reason = Timeout
142342024-11-09T03:00:33.015ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
142352024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 15 reason = Timeout
142362024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
142372024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
142382024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 29 reason = Timeout
142392024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 29 reason = Timeout
142402024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
142412024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
142422024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 29 reason = Timeout
142432024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
142442024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 29 reason = Timeout
142452024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 29 reason = Timeout
142462024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
142472024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
142482024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
142492024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 17 reason = Timeout
142502024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 29 reason = Timeout
142512024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
142522024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 85 reason = Timeout
142532024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 16 reason = Timeout
142542024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
142552024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
142562024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
142572024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 16 reason = Timeout
142582024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 17 reason = Timeout
142592024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 32 reason = Timeout
142602024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 29 reason = Timeout
142612024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
142622024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 15 reason = Timeout
142632024-11-09T03:00:33.015ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-11-09 02:50:33.015363782 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
142642024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 29 reason = Timeout
142652024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
142662024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
142672024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 29 reason = Timeout
142682024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 16 reason = Timeout
142692024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
142702024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
142712024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
142722024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 16 reason = Timeout
142732024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 85 reason = Timeout
142742024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 16 reason = Timeout
142752024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
142762024-11-09T03:00:33.015ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695
142772024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 18.29\u{b5}s iteration = 16 status = {"enabled":false,"target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695"}
142782024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 15 reason = Timeout
142792024-11-09T03:00:33.015ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
142802024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 16 reason = Timeout
142812024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
142822024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
142832024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
142842024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
142852024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 29 reason = Timeout
142862024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 29 reason = Timeout
142872024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 8.021\u{b5}s iteration = 29 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
142882024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 15 reason = Timeout
142892024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 14.201\u{b5}s iteration = 29 status = {"errors":[],"garbage_collect_requested":[]}
142902024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
142912024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 29 reason = Timeout
142922024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 5.07\u{b5}s iteration = 29 status = {"errors":[],"records_set_to_done":[]}
142932024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 29 reason = Timeout
142942024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 15 reason = Timeout
142952024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 7.34\u{b5}s iteration = 29 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
142962024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
142972024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
142982024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
142992024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
143002024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143012024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143022024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143032024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
143042024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143052024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
143062024-11-09T03:00:33.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
143072024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
143082024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
143092024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143102024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143112024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143122024-11-09T03:00:33.016ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("5cab3305-2cf8-4205-93bd-c0a5ec70688d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("e2d2fc82-684b-4404-ae54-ce48e33d41e3.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 350780997 } })
143132024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
143142024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
143152024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
143162024-11-09T03:00:33.016ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("504bb202-49f7-4613-ba58-ec4034140a6b.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("594379b7-4c26-4890-888e-966e710507da.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("bd994876-0077-4232-80e7-c0cfe919788f.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:3::1))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 350849499 } })
143172024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
143182024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.101093ms iteration = 16 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
143192024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } dns_group = internal
143202024-11-09T03:00:33.016ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.388569ms iteration = 16 status = {"addresses":["[fd00:1122:3344:2::1]:5353","[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353"]}
143212024-11-09T03:00:33.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143222024-11-09T03:00:33.019ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143232024-11-09T03:00:33.019ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143242024-11-09T03:00:33.019ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.527734ms iteration = 29 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
143252024-11-09T03:00:33.020ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143262024-11-09T03:00:33.020ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
143272024-11-09T03:00:33.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
143282024-11-09T03:00:33.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
143292024-11-09T03:00:33.021ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
143302024-11-09T03:00:33.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
143312024-11-09T03:00:33.022ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
143322024-11-09T03:00:33.022ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
143332024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
143342024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
143352024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143362024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143372024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
143382024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
143392024-11-09T03:00:33.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
143402024-11-09T03:00:33.025ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
143412024-11-09T03:00:33.026ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
143422024-11-09T03:00:33.026ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-11-09 02:50:33.015363782 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
143432024-11-09T03:00:33.026ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.179451ms iteration = 15 status = {"expiration":"2024-11-09T02:50:33.015363782Z","pruned":[]}
143442024-11-09T03:00:33.026ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143452024-11-09T03:00:33.027ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
143462024-11-09T03:00:33.027ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143472024-11-09T03:00:33.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
143482024-11-09T03:00:33.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143492024-11-09T03:00:33.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 363147193 } })
143502024-11-09T03:00:33.028ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
143512024-11-09T03:00:33.028ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
143522024-11-09T03:00:33.028ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 13.113241ms iteration = 15 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
143532024-11-09T03:00:33.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
143542024-11-09T03:00:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
143552024-11-09T03:00:33.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
143562024-11-09T03:00:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
143572024-11-09T03:00:33.030ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
143582024-11-09T03:00:33.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143592024-11-09T03:00:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
143602024-11-09T03:00:33.031ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
143612024-11-09T03:00:33.031ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143622024-11-09T03:00:33.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143632024-11-09T03:00:33.033ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 367816990 } })
143642024-11-09T03:00:33.033ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.782618ms iteration = 15 status = {"errors":[],"found_port_ok":[]}
143652024-11-09T03:00:33.033ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
143662024-11-09T03:00:33.034ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143672024-11-09T03:00:33.035ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143682024-11-09T03:00:33.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143692024-11-09T03:00:33.035ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1736, tv_nsec: 370292601 } })
143702024-11-09T03:00:33.035ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
143712024-11-09T03:00:33.037ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143722024-11-09T03:00:33.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143732024-11-09T03:00:33.039ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
143742024-11-09T03:00:33.043ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143752024-11-09T03:00:33.043ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
143762024-11-09T03:00:33.043ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
143772024-11-09T03:00:33.046ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
143782024-11-09T03:00:33.046ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
143792024-11-09T03:00:33.046ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
143802024-11-09T03:00:33.057ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
143812024-11-09T03:00:33.057ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.161752ms iteration = 85 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
143822024-11-09T03:00:33.059ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143832024-11-09T03:00:33.059ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
143842024-11-09T03:00:33.059ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143852024-11-09T03:00:33.059ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143862024-11-09T03:00:33.062ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
143872024-11-09T03:00:33.062ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
143882024-11-09T03:00:33.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
143892024-11-09T03:00:33.062ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143902024-11-09T03:00:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
143912024-11-09T03:00:33.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143922024-11-09T03:00:33.064ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
143932024-11-09T03:00:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
143942024-11-09T03:00:33.065ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
143952024-11-09T03:00:33.065ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
143962024-11-09T03:00:33.066ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
143972024-11-09T03:00:33.069ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
143982024-11-09T03:00:33.073ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
143992024-11-09T03:00:33.073ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144002024-11-09T03:00:33.073ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
144012024-11-09T03:00:33.073ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
144022024-11-09T03:00:33.073ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 58.722894ms iteration = 29 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
144032024-11-09T03:00:33.075ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.305246ms iteration = 85 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
144042024-11-09T03:00:33.075ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
144052024-11-09T03:00:33.075ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144062024-11-09T03:00:33.076ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144072024-11-09T03:00:33.076ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144082024-11-09T03:00:33.077ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
144092024-11-09T03:00:33.077ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
144102024-11-09T03:00:33.077ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
144112024-11-09T03:00:33.077ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144122024-11-09T03:00:33.077ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144132024-11-09T03:00:33.078ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
144142024-11-09T03:00:33.078ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144152024-11-09T03:00:33.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144162024-11-09T03:00:33.079ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144172024-11-09T03:00:33.080ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144182024-11-09T03:00:33.080ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144192024-11-09T03:00:33.083ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
144202024-11-09T03:00:33.083ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
144212024-11-09T03:00:33.083ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.017386ms iteration = 15 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
144222024-11-09T03:00:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
144232024-11-09T03:00:33.083ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144242024-11-09T03:00:33.083ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144252024-11-09T03:00:33.088ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144262024-11-09T03:00:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
144272024-11-09T03:00:33.090ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
144282024-11-09T03:00:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
144292024-11-09T03:00:33.090ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
144302024-11-09T03:00:33.090ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
144312024-11-09T03:00:33.107ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
144322024-11-09T03:00:33.107ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
144332024-11-09T03:00:33.107ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 92.253337ms iteration = 29 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
144342024-11-09T03:00:33.111ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
144352024-11-09T03:00:33.111ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
144362024-11-09T03:00:33.111ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
144372024-11-09T03:00:33.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144382024-11-09T03:00:33.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144392024-11-09T03:00:33.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144402024-11-09T03:00:33.116ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144412024-11-09T03:00:33.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144422024-11-09T03:00:33.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 103.07178ms iteration = 29 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
144432024-11-09T03:00:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
144442024-11-09T03:00:33.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
144452024-11-09T03:00:33.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
144462024-11-09T03:00:33.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
144472024-11-09T03:00:33.138ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
144482024-11-09T03:00:33.210ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
144492024-11-09T03:00:33.210ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144502024-11-09T03:00:33.210ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f2ddeeb-4eb6-4ca4-bc53-119fe0675083", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:32 GMT"} })
144512024-11-09T03:00:33.210ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144522024-11-09T03:00:33.212ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
144532024-11-09T03:00:33.254ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
144542024-11-09T03:00:33.254ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
144552024-11-09T03:00:33.255ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "64d765d4-6ac0-4fb4-b2b3-1abd279c7afd", "content-length": "372", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144562024-11-09T03:00:33.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144572024-11-09T03:00:33.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144582024-11-09T03:00:33.257ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144592024-11-09T03:00:33.258ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
144602024-11-09T03:00:33.258ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 0 version = 2
144612024-11-09T03:00:33.258ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
144622024-11-09T03:00:33.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
144632024-11-09T03:00:33.261ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
144642024-11-09T03:00:33.261ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144652024-11-09T03:00:33.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144662024-11-09T03:00:33.264ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144672024-11-09T03:00:33.265ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 250.208061ms iteration = 29 status = 0
144682024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
144692024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
144702024-11-09T03:00:33.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
144712024-11-09T03:00:33.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
144722024-11-09T03:00:33.275ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144732024-11-09T03:00:33.275ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "bfe75f34-1e4b-4c91-a7c1-e174f6ae0b9f", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:32 GMT"} })
144742024-11-09T03:00:33.275ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144752024-11-09T03:00:33.279ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
144762024-11-09T03:00:33.289ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
144772024-11-09T03:00:33.289ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
144782024-11-09T03:00:33.290ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "b8b0be3a-3c41-4841-bf1d-fc92810e5250", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144792024-11-09T03:00:33.290ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144802024-11-09T03:00:33.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144812024-11-09T03:00:33.295ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144822024-11-09T03:00:33.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144832024-11-09T03:00:33.307ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
144842024-11-09T03:00:33.308ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
144852024-11-09T03:00:33.313ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
144862024-11-09T03:00:33.313ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
144872024-11-09T03:00:33.313ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
144882024-11-09T03:00:33.314ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "0d17672b-920a-4b6c-a487-f2c15495607f", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
144892024-11-09T03:00:33.316ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
144902024-11-09T03:00:33.317ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
144912024-11-09T03:00:33.318ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 302.999212ms iteration = 30 status = {}
144922024-11-09T03:00:33.319ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
144932024-11-09T03:00:33.319ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
144942024-11-09T03:00:33.319ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ab6851e8-d928-4c01-9742-f9a943cb4d22", "content-length": "26", "date": "Sat, 09 Nov 2024 03:00:32 GMT"} })
144952024-11-09T03:00:33.319ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
144962024-11-09T03:00:33.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
144972024-11-09T03:00:33.319ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
144982024-11-09T03:00:33.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
144992024-11-09T03:00:33.321ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
145002024-11-09T03:00:33.321ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
145012024-11-09T03:00:33.321ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145022024-11-09T03:00:33.321ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145032024-11-09T03:00:33.322ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145042024-11-09T03:00:33.322ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
145052024-11-09T03:00:33.323ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "03c701c5-cd7e-4357-baa6-b8730a151cfa", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
145062024-11-09T03:00:33.323ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
145072024-11-09T03:00:33.324ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cce29f6c-2094-47ea-aeac-cbbb4bb2909f", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
145082024-11-09T03:00:33.324ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
145092024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
145102024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
145112024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
145122024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
145132024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
145142024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
145152024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
145162024-11-09T03:00:33.325ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
145172024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
145182024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
145192024-11-09T03:00:33.325ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 310.431175ms iteration = 17 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
145202024-11-09T03:00:33.328ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4365d6ad-8cfe-4b20-994f-a53ab1deab95 dns_zone_name = oxide.test found_so_far = 1 version = 2
145212024-11-09T03:00:33.328ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
145222024-11-09T03:00:33.328ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-11-09 02:47:08.311547 UTC dns_group = external generation = 2
145232024-11-09T03:00:33.328ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 313.426778ms iteration = 16 status = {"generation":2}
145242024-11-09T03:00:33.351ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
145252024-11-09T03:00:33.351ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
145262024-11-09T03:00:33.351ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145272024-11-09T03:00:33.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145282024-11-09T03:00:33.376ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-11-09T02:46:30.213204Z, time_modified: 2024-11-09T02:46:30.213204Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, db_silo: Silo { identity: SiloIdentity { id: 8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-11-09T02:47:08.255508Z, time_modified: 2024-11-09T02:47:08.255508Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(4)) }, tls_certs: [TlsCertificate { digest: "224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c" }] }) }
145292024-11-09T03:00:33.376ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 361.02748ms iteration = 16 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]}},"default_endpoint":{"silo_id":"8ca6dc86-4894-40ad-89a9-2ffb8afbe6bd","tls_certs":["224687fa43b7d42042e443ae67b044081b80cae3ec846213e9662f920e2d422c"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
145302024-11-09T03:00:33.377ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
145312024-11-09T03:00:33.377ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 362.083103ms iteration = 15 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
145322024-11-09T03:00:33.382ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
145332024-11-09T03:00:33.383ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 368.545656ms iteration = 32 status = {"physical_disks_added":0}
145342024-11-09T03:00:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
145352024-11-09T03:00:33.385ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
145362024-11-09T03:00:33.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
145372024-11-09T03:00:33.388ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = 54a80f7c-c41b-4c5d-9acd-e8fbe05ea509 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
145382024-11-09T03:00:33.388ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
145392024-11-09T03:00:33.388ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-11-09 02:47:07.517777 UTC dns_group = internal generation = 1
145402024-11-09T03:00:33.388ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 372.793103ms iteration = 16 status = {"generation":1}
145412024-11-09T03:00:33.390ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 374.881477ms iteration = 29 status = {}
145422024-11-09T03:00:33.428ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
145432024-11-09T03:00:33.429ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "cf24579c-8a36-4f08-bf8a-35475eaf8a9e", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145442024-11-09T03:00:33.429ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145452024-11-09T03:00:33.431ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6901bb01-4f79-4f8a-861e-abffedabf2d2", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145462024-11-09T03:00:33.431ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145472024-11-09T03:00:33.436ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d5aaedf0-d9bf-4eeb-afff-08654c11631d", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145482024-11-09T03:00:33.436ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145492024-11-09T03:00:33.438ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:2::1]:5353, [fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353] }
145502024-11-09T03:00:33.438ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 423.477451ms iteration = 17 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
145512024-11-09T03:00:33.488ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
145522024-11-09T03:00:33.488ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e07b4780-89a9-469f-8779-b85e44275ea3", "content-length": "691", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145532024-11-09T03:00:33.488ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
145542024-11-09T03:00:33.488ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
145552024-11-09T03:00:33.488ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
145562024-11-09T03:00:33.489ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 474.657138ms iteration = 29 status = {}
145572024-11-09T03:00:33.519ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
145582024-11-09T03:00:33.519ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "60781b1c-41fc-43f5-82c6-5c5624617462", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145592024-11-09T03:00:33.522ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
145602024-11-09T03:00:33.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
145612024-11-09T03:00:33.524ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 509.217103ms iteration = 29 status = null
145622024-11-09T03:00:33.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145632024-11-09T03:00:33.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145642024-11-09T03:00:33.556ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
145652024-11-09T03:00:33.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145662024-11-09T03:00:33.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145672024-11-09T03:00:33.567ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
145682024-11-09T03:00:33.567ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "97e8ae59-bb69-45de-85de-3343cf09a6f8", "content-length": "134", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145692024-11-09T03:00:33.567ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
145702024-11-09T03:00:33.567ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
145712024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
145722024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
145732024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145742024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145752024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145762024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
145772024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
145782024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
145792024-11-09T03:00:33.568ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
145802024-11-09T03:00:33.568ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145812024-11-09T03:00:33.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145822024-11-09T03:00:33.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
145832024-11-09T03:00:33.570ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "69521fb7-9cfc-480a-8aeb-1c9278fea7aa", "content-length": "2", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145842024-11-09T03:00:33.570ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
145852024-11-09T03:00:33.570ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ea2c5c40-dfe6-4e0f-9b90-0333ec563df0", "content-length": "52", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145862024-11-09T03:00:33.570ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
145872024-11-09T03:00:33.570ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
145882024-11-09T03:00:33.682ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "30487d13-a0b7-4a35-b5a4-09e84da1638f", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145892024-11-09T03:00:33.682ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
145902024-11-09T03:00:33.682ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
145912024-11-09T03:00:33.687ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "be3f22b9-5fe3-4690-ad7c-8a4e55d3c864", "content-length": "682", "date": "Sat, 09 Nov 2024 03:00:33 GMT"} })
145922024-11-09T03:00:33.687ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145932024-11-09T03:00:33.687ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145942024-11-09T03:00:33.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145952024-11-09T03:00:33.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145962024-11-09T03:00:33.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145972024-11-09T03:00:33.695ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
145982024-11-09T03:00:33.696ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
145992024-11-09T03:00:33.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146002024-11-09T03:00:33.704ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 689.439858ms iteration = 29 status = {}
146012024-11-09T03:00:43.014ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 86 reason = Timeout
146022024-11-09T03:00:43.014ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 86 reason = Timeout
146032024-11-09T03:00:43.014ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146042024-11-09T03:00:43.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146052024-11-09T03:00:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146062024-11-09T03:00:43.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146072024-11-09T03:00:43.041ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146082024-11-09T03:00:43.041ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146092024-11-09T03:00:43.042ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 28.06072ms iteration = 86 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146102024-11-09T03:00:43.044ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146112024-11-09T03:00:43.047ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146122024-11-09T03:00:43.047ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146132024-11-09T03:00:43.047ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146142024-11-09T03:00:43.049ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146152024-11-09T03:00:43.049ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146162024-11-09T03:00:43.051ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146172024-11-09T03:00:43.054ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
146182024-11-09T03:00:43.054ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146192024-11-09T03:00:43.054ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146202024-11-09T03:00:43.065ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
146212024-11-09T03:00:43.065ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.530775ms iteration = 86 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
146222024-11-09T03:00:45.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1050 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 2fa52821-22ed-443a-8028-294718a46327 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
146232024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 87 reason = Timeout
146242024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146252024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 87 reason = Timeout
146262024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146272024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146282024-11-09T03:00:53.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146292024-11-09T03:00:53.017ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146302024-11-09T03:00:53.018ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146312024-11-09T03:00:53.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146322024-11-09T03:00:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
146332024-11-09T03:00:53.020ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146342024-11-09T03:00:53.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146352024-11-09T03:00:53.022ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146362024-11-09T03:00:53.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146372024-11-09T03:00:53.024ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146382024-11-09T03:00:53.026ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
146392024-11-09T03:00:53.026ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146402024-11-09T03:00:53.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146412024-11-09T03:00:53.038ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
146422024-11-09T03:00:53.038ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.000506ms iteration = 87 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
146432024-11-09T03:00:53.046ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.775707ms iteration = 87 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
146442024-11-09T03:01:00.154ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.12.0/src/server.rs:950 latency_us = 1108 local_addr = [fd00:1122:3344:101::c]:33295 method = GET remote_addr = [fd00:1122:3344:101::d]:34571 req_id = 29d0894e-d8e2-4f3a-b76e-30d1284efb53 response_code = 200 uri = /0339f029-6c8d-4b23-83cc-6885965f777d
146452024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 88 reason = Timeout
146462024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 88 reason = Timeout
146472024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
146482024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 30 reason = Timeout
146492024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
146502024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
146512024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 33 reason = Timeout
146522024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
146532024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 30 reason = Timeout
146542024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 30 reason = Timeout
146552024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146562024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
146572024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 30 reason = Timeout
146582024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 31 reason = Timeout
146592024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
146602024-11-09T03:01:03.015ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
146612024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 30 reason = Timeout
146622024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
146632024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
146642024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 30 reason = Timeout
146652024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
146662024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 30 reason = Timeout
146672024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
146682024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 30 reason = Timeout
146692024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
146702024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
146712024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 30 reason = Timeout
146722024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
146732024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146742024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
146752024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
146762024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
146772024-11-09T03:01:03.015ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
146782024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
146792024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
146802024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
146812024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
146822024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
146832024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
146842024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 30 reason = Timeout
146852024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 12.49\u{b5}s iteration = 30 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
146862024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 30 reason = Timeout
146872024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 30 reason = Timeout
146882024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 3.65\u{b5}s iteration = 30 status = {"errors":[],"garbage_collect_requested":[]}
146892024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 30 reason = Timeout
146902024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 9.72\u{b5}s iteration = 30 status = {"errors":[],"records_set_to_done":[]}
146912024-11-09T03:01:03.016ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 5.29\u{b5}s iteration = 30 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
146922024-11-09T03:01:03.017ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146932024-11-09T03:01:03.018ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146942024-11-09T03:01:03.018ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
146952024-11-09T03:01:03.019ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.521023ms iteration = 30 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
146962024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
146972024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
146982024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
146992024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
147002024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147012024-11-09T03:01:03.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147022024-11-09T03:01:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
147032024-11-09T03:01:03.021ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147042024-11-09T03:01:03.021ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147052024-11-09T03:01:03.025ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147062024-11-09T03:01:03.027ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 361773125 } })
147072024-11-09T03:01:03.027ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1114
147082024-11-09T03:01:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
147092024-11-09T03:01:03.027ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
147102024-11-09T03:01:03.027ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
147112024-11-09T03:01:03.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 362542011 } })
147122024-11-09T03:01:03.028ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147132024-11-09T03:01:03.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1114 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
147142024-11-09T03:01:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147152024-11-09T03:01:03.028ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147162024-11-09T03:01:03.028ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-f032ba4a-ac68-41c0-a068-00d3371df648.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 1766, tv_nsec: 363201014 } })
147172024-11-09T03:01:03.028ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147182024-11-09T03:01:03.028ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1114
147192024-11-09T03:01:03.030ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147202024-11-09T03:01:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
147212024-11-09T03:01:03.032ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
147222024-11-09T03:01:03.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
147232024-11-09T03:01:03.055ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147242024-11-09T03:01:03.056ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
147252024-11-09T03:01:03.056ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
147262024-11-09T03:01:03.057ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147272024-11-09T03:01:03.057ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147282024-11-09T03:01:03.057ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147292024-11-09T03:01:03.058ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
147302024-11-09T03:01:03.058ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
147312024-11-09T03:01:03.058ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147322024-11-09T03:01:03.059ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147332024-11-09T03:01:03.060ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147342024-11-09T03:01:03.061ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
147352024-11-09T03:01:03.061ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
147362024-11-09T03:01:03.062ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147372024-11-09T03:01:03.062ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
147382024-11-09T03:01:03.062ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147392024-11-09T03:01:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
147402024-11-09T03:01:03.062ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147412024-11-09T03:01:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 943f6b47-dfd6-4298-87b5-a0ee7f38a695, lookup_type: ById(943f6b47-dfd6-4298-87b5-a0ee7f38a695) } result = Ok(())
147422024-11-09T03:01:03.063ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
147432024-11-09T03:01:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
147442024-11-09T03:01:03.063ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
147452024-11-09T03:01:03.063ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147462024-11-09T03:01:03.064ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147472024-11-09T03:01:03.066ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147482024-11-09T03:01:03.066ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147492024-11-09T03:01:03.067ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147502024-11-09T03:01:03.067ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147512024-11-09T03:01:03.068ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
147522024-11-09T03:01:03.068ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 53.633489ms iteration = 30 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
147532024-11-09T03:01:03.074ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
147542024-11-09T03:01:03.074ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147552024-11-09T03:01:03.075ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "83f04b2b-98b3-4b3f-b51f-0d21ea9ad98e", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
147562024-11-09T03:01:03.075ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147572024-11-09T03:01:03.076ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147582024-11-09T03:01:03.076ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1122 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 zone_address = fd00:1122:3344:101::2
147592024-11-09T03:01:03.076ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147602024-11-09T03:01:03.077ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1122 zone_address = fd00:1122:3344:101::2
147612024-11-09T03:01:03.077ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
147622024-11-09T03:01:03.077ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "6d2ea527-7c53-41eb-b8eb-fb3d149831a0", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
147632024-11-09T03:01:03.077ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1127 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147642024-11-09T03:01:03.077ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c2257faf-7dc9-43e7-a4ea-7e26e22d5521", "content-length": "26", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
147652024-11-09T03:01:03.077ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1127 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
147662024-11-09T03:01:03.079ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
147672024-11-09T03:01:03.080ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1159 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
147682024-11-09T03:01:03.082ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 original_time_created = 2024-11-09 02:46:20.803896 UTC target_id = 943f6b47-dfd6-4298-87b5-a0ee7f38a695 time_created = 2024-11-09 02:46:20.803896 UTC
147692024-11-09T03:01:03.082ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.935383ms iteration = 88 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"943f6b47-dfd6-4298-87b5-a0ee7f38a695","time_created":"2024-11-09T02:46:20.803896Z"}
147702024-11-09T03:01:03.087ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 72.674331ms iteration = 88 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
147712024-11-09T03:01:03.088ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 73.136852ms iteration = 30 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
147722024-11-09T03:01:03.094ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147732024-11-09T03:01:03.094ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
147742024-11-09T03:01:03.094ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
147752024-11-09T03:01:03.094ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
147762024-11-09T03:01:03.096ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147772024-11-09T03:01:03.096ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147782024-11-09T03:01:03.098ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147792024-11-09T03:01:03.098ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147802024-11-09T03:01:03.100ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147812024-11-09T03:01:03.102ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: f032ba4a-ac68-41c0-a068-00d3371df648, lookup_type: ById(f032ba4a-ac68-41c0-a068-00d3371df648) } result = Ok(())
147822024-11-09T03:01:03.102ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
147832024-11-09T03:01:03.103ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
147842024-11-09T03:01:03.104ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 88.852746ms iteration = 30 status = 0
147852024-11-09T03:01:03.123ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
147862024-11-09T03:01:03.123ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
147872024-11-09T03:01:03.123ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 107.699075ms iteration = 30 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
147882024-11-09T03:01:03.135ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.375277ms iteration = 33 status = {"physical_disks_added":0}
147892024-11-09T03:01:03.152ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 136.779117ms iteration = 30 status = {}
147902024-11-09T03:01:03.153ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
147912024-11-09T03:01:03.153ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "b1993b07-d0a8-497a-96ce-4ef8833d9941", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:02 GMT"} })
147922024-11-09T03:01:03.156ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
147932024-11-09T03:01:03.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
147942024-11-09T03:01:03.163ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 148.516909ms iteration = 30 status = null
147952024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
147962024-11-09T03:01:03.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
147972024-11-09T03:01:03.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
147982024-11-09T03:01:03.177ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
147992024-11-09T03:01:03.177ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148002024-11-09T03:01:03.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148012024-11-09T03:01:03.179ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
148022024-11-09T03:01:03.182ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
148032024-11-09T03:01:03.182ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
148042024-11-09T03:01:03.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
148052024-11-09T03:01:03.209ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
148062024-11-09T03:01:03.209ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148072024-11-09T03:01:03.210ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5032e58-b28c-47ee-a6a7-7596fbcfa540", "content-length": "372", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148082024-11-09T03:01:03.210ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148092024-11-09T03:01:03.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148102024-11-09T03:01:03.254ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = buskin
148112024-11-09T03:01:03.255ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
148122024-11-09T03:01:03.255ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "4e801cdf-d1cc-4a78-9608-014950db13d7", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148132024-11-09T03:01:03.255ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148142024-11-09T03:01:03.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148152024-11-09T03:01:03.257ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148162024-11-09T03:01:03.258ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148172024-11-09T03:01:03.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148182024-11-09T03:01:03.258ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148192024-11-09T03:01:03.260ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: ef0256b1-2ab7-4395-808a-22c7364e702d, rack_id: 5bbfcf9f-0313-44b5-8699-fd964d8a4a29, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(5aab5bf0-146e-4121-8f92-a93166ca71e6) } rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
148202024-11-09T03:01:03.260ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148212024-11-09T03:01:03.260ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148222024-11-09T03:01:03.287ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
148232024-11-09T03:01:03.287ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc37b21e-290e-45b9-a380-e753ab4d0699", "content-length": "691", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148242024-11-09T03:01:03.287ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = buskin
148252024-11-09T03:01:03.287ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = buskin
148262024-11-09T03:01:03.287ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = buskin
148272024-11-09T03:01:03.290ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 275.579146ms iteration = 30 status = {}
148282024-11-09T03:01:03.292ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
148292024-11-09T03:01:03.292ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
148302024-11-09T03:01:03.296ZINFOnexus (BackgroundTasks): VPC route manager sled f032ba4a-ac68-41c0-a068-00d3371df648 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
148312024-11-09T03:01:03.296ZDEBGnexus (BackgroundTasks): client request SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
148322024-11-09T03:01:03.296ZDEBGnexus (BackgroundTasks): client response SledAgent = f032ba4a-ac68-41c0-a068-00d3371df648 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "136a9360-bba9-4095-911a-62e161b5e40e", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148332024-11-09T03:01:03.298ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 283.053849ms iteration = 31 status = {}
148342024-11-09T03:01:03.301ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
148352024-11-09T03:01:03.302ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "bff95b2c-bfa6-44c1-9444-a85940c8a850", "content-length": "134", "date": "Sat, 09 Nov 2024 03:01:02 GMT"} })
148362024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1747 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.1.174], params: LinkCreate { autoneg: false, fec: None, kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
148372024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = 5aab5bf0-146e-4121-8f92-a93166ca71e6
148382024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
148392024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: {(10.151.1.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
148402024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148412024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148422024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148432024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1921 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148442024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
148452024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1957 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.1.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
148462024-11-09T03:01:03.302ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29
148472024-11-09T03:01:03.303ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148482024-11-09T03:01:03.303ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148492024-11-09T03:01:03.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
148502024-11-09T03:01:03.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "35566078-3c21-40cc-b640-1dceeaabdc05", "content-length": "2", "date": "Sat, 09 Nov 2024 03:01:02 GMT"} })
148512024-11-09T03:01:03.305ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
148522024-11-09T03:01:03.305ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "6174383b-2f92-47ee-acc2-801096101173", "content-length": "52", "date": "Sat, 09 Nov 2024 03:01:02 GMT"} })
148532024-11-09T03:01:03.305ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.1.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch_location = Switch0
148542024-11-09T03:01:03.305ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
148552024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8bb10a8f-cd3c-4903-a461-ae26d061f7f0", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148562024-11-09T03:01:03.437ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 switch = Switch0
148572024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
148582024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = 5bbfcf9f-0313-44b5-8699-fd964d8a4a29 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "21e00540-77ed-4854-88f2-f785da657541", "content-length": "682", "date": "Sat, 09 Nov 2024 03:01:03 GMT"} })
148592024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148602024-11-09T03:01:03.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148612024-11-09T03:01:03.441ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148622024-11-09T03:01:03.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148632024-11-09T03:01:03.446ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148642024-11-09T03:01:03.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148652024-11-09T03:01:03.450ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
148662024-11-09T03:01:03.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
148672024-11-09T03:01:03.459ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 443.816622ms iteration = 30 status = {}