Max level shown:
1 [ Dec 12 22:34:13 Enabled. ]
2 [ Dec 12 22:34:13 Rereading configuration. ]
3 [ Dec 12 22:34:14 Rereading configuration. ]
4 [ Dec 12 22:34:22 Executing start method ("ctrun -l child -o noorphan,regent /opt/oxide/omicron-nexus/bin/nexus /var/svc/manifest/site/nexus/config.toml &"). ]
5 [ Dec 12 22:34:22 Method "start" exited with status 0. ]
6 note: configured to log to "/dev/stdout"
72024-12-12T22:34:22.707ZDEBGnexus: registered DTrace probes
82024-12-12T22:34:22.710ZINFOnexus: setting up nexus server file = nexus/src/lib.rs:75
92024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Action file = nexus/auth/src/authz/oso_generic.rs:68
102024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = AnyActor file = nexus/auth/src/authz/oso_generic.rs:68
112024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = AuthenticatedActor file = nexus/auth/src/authz/oso_generic.rs:68
122024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = BlueprintConfig file = nexus/auth/src/authz/oso_generic.rs:68
132024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Database file = nexus/auth/src/authz/oso_generic.rs:68
142024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = DnsConfig file = nexus/auth/src/authz/oso_generic.rs:68
152024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Fleet file = nexus/auth/src/authz/oso_generic.rs:68
162024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Inventory file = nexus/auth/src/authz/oso_generic.rs:68
172024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = IpPoolList file = nexus/auth/src/authz/oso_generic.rs:68
182024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = ConsoleSessionList file = nexus/auth/src/authz/oso_generic.rs:68
192024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequestList file = nexus/auth/src/authz/oso_generic.rs:68
202024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = SiloCertificateList file = nexus/auth/src/authz/oso_generic.rs:68
212024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = SiloIdentityProviderList file = nexus/auth/src/authz/oso_generic.rs:68
222024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = SiloUserList file = nexus/auth/src/authz/oso_generic.rs:68
232024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Project file = nexus/auth/src/authz/oso_generic.rs:68
242024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Disk file = nexus/auth/src/authz/oso_generic.rs:68
252024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Snapshot file = nexus/auth/src/authz/oso_generic.rs:68
262024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = ProjectImage file = nexus/auth/src/authz/oso_generic.rs:68
272024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Instance file = nexus/auth/src/authz/oso_generic.rs:68
282024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = IpPool file = nexus/auth/src/authz/oso_generic.rs:68
292024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = InstanceNetworkInterface file = nexus/auth/src/authz/oso_generic.rs:68
302024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = Vpc file = nexus/auth/src/authz/oso_generic.rs:68
312024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = VpcRouter file = nexus/auth/src/authz/oso_generic.rs:68
322024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = InternetGateway file = nexus/auth/src/authz/oso_generic.rs:68
332024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpPool file = nexus/auth/src/authz/oso_generic.rs:68
342024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = InternetGatewayIpAddress file = nexus/auth/src/authz/oso_generic.rs:68
352024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = RouterRoute file = nexus/auth/src/authz/oso_generic.rs:68
362024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = VpcSubnet file = nexus/auth/src/authz/oso_generic.rs:68
372024-12-12T22:34:22.718ZINFOnexus (ServerContext): registering Oso class class = FloatingIp file = nexus/auth/src/authz/oso_generic.rs:68
382024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Image file = nexus/auth/src/authz/oso_generic.rs:68
392024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = SiloImage file = nexus/auth/src/authz/oso_generic.rs:68
402024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = AddressLot file = nexus/auth/src/authz/oso_generic.rs:68
412024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Blueprint file = nexus/auth/src/authz/oso_generic.rs:68
422024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = LoopbackAddress file = nexus/auth/src/authz/oso_generic.rs:68
432024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Certificate file = nexus/auth/src/authz/oso_generic.rs:68
442024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = ConsoleSession file = nexus/auth/src/authz/oso_generic.rs:68
452024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = DeviceAuthRequest file = nexus/auth/src/authz/oso_generic.rs:68
462024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = DeviceAccessToken file = nexus/auth/src/authz/oso_generic.rs:68
472024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = PhysicalDisk file = nexus/auth/src/authz/oso_generic.rs:68
482024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Rack file = nexus/auth/src/authz/oso_generic.rs:68
492024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = RoleBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
502024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = SshKey file = nexus/auth/src/authz/oso_generic.rs:68
512024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Silo file = nexus/auth/src/authz/oso_generic.rs:68
522024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = SiloUser file = nexus/auth/src/authz/oso_generic.rs:68
532024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = SiloGroup file = nexus/auth/src/authz/oso_generic.rs:68
542024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = IdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
552024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = SamlIdentityProvider file = nexus/auth/src/authz/oso_generic.rs:68
562024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Sled file = nexus/auth/src/authz/oso_generic.rs:68
572024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = TufRepo file = nexus/auth/src/authz/oso_generic.rs:68
582024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = TufArtifact file = nexus/auth/src/authz/oso_generic.rs:68
592024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Zpool file = nexus/auth/src/authz/oso_generic.rs:68
602024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = Service file = nexus/auth/src/authz/oso_generic.rs:68
612024-12-12T22:34:22.719ZINFOnexus (ServerContext): registering Oso class class = UserBuiltin file = nexus/auth/src/authz/oso_generic.rs:68
622024-12-12T22:34:22.719ZINFOnexus (ServerContext): full Oso configuration config = #\n# Oso configuration for Omicron\n# This file is augmented by generated snippets.\n#\n\n#\n# ACTOR TYPES AND BASIC RULES\n#\n\n# `AnyActor` includes both authenticated and unauthenticated users.\nactor AnyActor {}\n\n# An `AuthenticatedActor` has an identity in the system. All of our operations\n# today require that an actor be authenticated.\nactor AuthenticatedActor {}\n\n# For any resource, `actor` can perform action `action` on it if they're\n# authenticated and their role(s) give them the corresponding permission on that\n# resource.\nallow(actor: AnyActor, action: Action, resource) if\n actor.authenticated and\n has_permission(actor.authn_actor.unwrap(), action.to_perm(), resource);\n\n# Define role relationships\nhas_role(actor: AuthenticatedActor, role: String, resource: Resource)\n\tif resource.has_role(actor, role);\n\n#\n# ROLES AND PERMISSIONS IN THE FLEET/SILO/PROJECT HIERARCHY\n#\n# We define the following permissions for most resources in the system:\n#\n# - "create_child": required to create child resources (of any type)\n#\n# - "list_children": required to list child resources (of all types) of a\n# resource\n#\n# - "modify": required to modify or delete a resource\n#\n# - "read": required to read a resource\n#\n# We define the following predefined roles for only a few high-level resources:\n# the Fleet (see below), Silo, Organization, and Project. The specific roles\n# are oriented around intended use-cases:\n#\n# - "admin": has all permissions on the resource\n#\n# - "collaborator": has "read", "list_children", and "create_child", plus\n# the "admin" role for child resources. The idea is that if you're an\n# Organization Collaborator, you have full control over the Projects within\n# the Organization, but you cannot modify or delete the Organization itself.\n#\n# - "viewer": has "read" and "list_children" on a resource\n#\n# Below the Project level, permissions are granted via roles at the Project\n# level. For example, for someone to be able to create, modify, or delete any\n# Instances, they must be granted project.collaborator, which means they can\n# create, modify, or delete _all_ resources in the Project.\n#\n# The complete set of predefined roles:\n#\n# - fleet.admin (superuser for the whole system)\n# - fleet.collaborator (can manage Silos)\n# - fleet.viewer (can read most non-siloed resources in the system)\n# - silo.admin (superuser for the silo)\n# - silo.collaborator (can create and own Organizations)\n# - silo.viewer (can read most resources within the Silo)\n# - organization.admin (complete control over an organization)\n# - organization.collaborator (can manage Projects)\n# - organization.viewer (can read most resources within the Organization)\n# - project.admin (complete control over a Project)\n# - project.collaborator (can manage all resources within the Project)\n# - project.viewer (can read most resources within the Project)\n#\n# Outside the Silo/Organization/Project hierarchy, we (currently) treat most\n# resources as nested under Fleet or else a synthetic resource (see below). We\n# do not yet support role assignments on anything other than Fleet, Silo,\n# Organization, or Project.\n#\n\n# "Fleet" is a global singleton representing the whole system. The name comes\n# from the idea described in RFD 24, but it's not quite right. This probably\n# should be more like "Region" or "AvailabilityZone". The precise boundaries\n# have not yet been figured out.\nresource Fleet {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\troles = [\n\t # Roles that can be attached by users\n\t "admin",\n\t "collaborator",\n\t "viewer",\n\n\t # Internal-only roles\n\t "external-authenticator"\n\t];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n}\n\n# For fleets specifically, roles can be conferred by roles on the user's Silo.\nhas_role(actor: AuthenticatedActor, role: String, _: Fleet) if\n\tsilo_role in actor.confers_fleet_role(role) and\n\thas_role(actor, silo_role, actor.silo.unwrap());\n\nresource Silo {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Permissions implied by roles on this resource's parent (Fleet). Fleet\n\t# privileges allow a user to see and potentially administer the Silo,\n\t# but they do not give anyone permission to look at anything inside the\n\t# Silo. To achieve this, we use permission rules here. (If we granted\n\t# Fleet administrators _roles_ on the Silo, then those would cascade\n\t# into the Silo as well.)\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "collaborator" on "parent_fleet";\n\n\t# external authenticator has to create silo users\n\t"list_children" if "external-authenticator" on "parent_fleet";\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\n\nhas_relation(fleet: Fleet, "parent_fleet", silo: Silo)\n\tif silo.fleet = fleet;\n\n# As a special case, all authenticated users can read their own Silo. That's\n# not quite the same as having the "viewer" role. For example, they cannot list\n# Organizations in the Silo.\n#\n# One reason this is necessary is because if an unprivileged user tries to\n# create an Organization using "POST /organizations", they should get back a 403\n# (which implies they're able to see /organizations, which is essentially seeing\n# the Silo itself) rather than a 404. This behavior isn't a hard constraint\n# (i.e., you could reasonably get a 404 for an API you're not allowed to call).\n# Nor is the implementation (i.e., we could special-case this endpoint somehow).\n# But granting this permission is the simplest way to keep this endpoint's\n# behavior consistent with the rest of the API.\n#\n# This rule is also used to determine if a user can list the identity providers\n# in the Silo (which they should be able to), since that's predicated on being\n# able to read the Silo.\n#\n# It's unclear what else would break if users couldn't see their own Silo.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif silo in actor.silo;\n\nresource Project {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\troles = [ "admin", "collaborator", "viewer" ];\n\n\t# Roles implied by other roles on this resource\n\t"viewer" if "collaborator";\n\t"collaborator" if "admin";\n\n\t# Permissions granted directly by roles on this resource\n\t"list_children" if "viewer";\n\t"read" if "viewer";\n\t"create_child" if "collaborator";\n\t"modify" if "admin";\n\n\t# Roles implied by roles on this resource's parent (Silo)\n\trelations = { parent_silo: Silo };\n\t"admin" if "collaborator" on "parent_silo";\n\t"viewer" if "viewer" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", project: Project)\n\tif project.silo = silo;\n\n#\n# GENERAL RESOURCES OUTSIDE THE SILO/PROJECT HIERARCHY\n#\n# Many resources use snippets of Polar generated by the `authz_resource!` Rust\n# macro. Some resources require custom Polar code. Those appear here.\n#\n\nresource Certificate {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Fleet-level and silo-level roles both grant privileges on certificates.\n\t"read" if "admin" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", certificate: Certificate)\n\tif certificate.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", certificate: Certificate)\n\tif certificate.silo.fleet = fleet;\n\nresource SiloUser {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\t# Fleet and Silo administrators can manage a Silo's users. This is one\n\t# of the only areas of Silo configuration that Fleet Administrators have\n\t# permissions on.\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "read" on "parent_fleet";\n\t"read" if "read" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", user: SiloUser)\n\tif user.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", user: SiloUser)\n\tif user.silo.fleet = fleet;\n\n# authenticated actors have all permissions on themselves\nhas_permission(actor: AuthenticatedActor, _perm: String, silo_user: SiloUser)\n if actor.equals_silo_user(silo_user);\n\nhas_permission(actor: AuthenticatedActor, "read", silo_user: SiloUser)\n if silo_user.silo in actor.silo;\n\nresource SiloGroup {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "read",\n\t "create_child",\n\t];\n\n\trelations = { parent_silo: Silo };\n\t"list_children" if "read" on "parent_silo";\n\t"read" if "read" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n}\nhas_relation(silo: Silo, "parent_silo", group: SiloGroup)\n\tif group.silo = silo;\n\nresource SshKey {\n\tpermissions = [ "read", "modify" ];\n\trelations = { silo_user: SiloUser };\n\n\t"read" if "read" on "silo_user";\n\t"modify" if "modify" on "silo_user";\n}\nhas_relation(user: SiloUser, "silo_user", ssh_key: SshKey)\n\tif ssh_key.silo_user = user;\n\nresource IdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", identity_provider: IdentityProvider)\n\tif identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: IdentityProvider)\n\tif collection.silo.fleet = fleet;\n\nresource SamlIdentityProvider {\n\tpermissions = [\n\t "read",\n\t "modify",\n\t "create_child",\n\t "list_children",\n\t];\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Silo-level roles grant privileges on identity providers.\n\t"read" if "viewer" on "parent_silo";\n\t"list_children" if "viewer" on "parent_silo";\n\t"modify" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_silo";\n\n\t# Fleet-level roles also grant privileges on identity providers.\n\t"read" if "viewer" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", saml_identity_provider: SamlIdentityProvider)\n\tif saml_identity_provider.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SamlIdentityProvider)\n\tif collection.silo.fleet = fleet;\n\n#\n# SYNTHETIC RESOURCES OUTSIDE THE SILO HIERARCHY\n#\n# The resources here do not correspond to anything that appears explicitly in\n# the API or is stored in the database. These are used either at the top level\n# of the API path (e.g., "/v1/system/ip-pools") or as an implementation detail of the system\n# (in the case of console sessions and "Database"). The policies are\n# either statically-defined in this file or driven by role assignments on the\n# Fleet. None of these resources defines their own roles.\n#\n\n# Describes the policy for reading and modifying DNS configuration\n# (both internal and external)\nresource DnsConfig {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t# "external-authenticator" requires these permissions because that's the\n\t# context that Nexus uses when creating and deleting Silos. These\n\t# operations necessarily need to read and modify DNS configuration.\n\t"read" if "external-authenticator" on "parent_fleet";\n\t"modify" if "external-authenticator" on "parent_fleet";\n\t# "admin" on the parent fleet also gets these permissions, primarily for\n\t# the test suite.\n\t"read" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", dns_config: DnsConfig)\n\tif dns_config.fleet = fleet;\n\n# Describes the policy for accessing blueprints\nresource BlueprintConfig {\n\tpermissions = [\n\t "list_children", # list blueprints\n\t "create_child", # create blueprint\n\t "read", # read the current target\n\t "modify", # change the current target\n\t];\n\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "admin" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n\t"list_children" if "viewer" on "parent_fleet";\n\t"read" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", list: BlueprintConfig)\n\tif list.fleet = fleet;\n\n# Describes the policy for reading and modifying low-level inventory\nresource Inventory {\n\tpermissions = [ "read", "modify" ];\n\trelations = { parent_fleet: Fleet };\n\t"read" if "viewer" on "parent_fleet";\n\t"modify" if "admin" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", inventory: Inventory)\n\tif inventory.fleet = fleet;\n\n# Describes the policy for accessing "/v1/system/ip-pools" in the API\nresource IpPoolList {\n\tpermissions = [\n\t "list_children",\n\t "modify",\n\t "create_child",\n\t];\n\n\t# Fleet Administrators can create or modify the IP Pools list.\n\trelations = { parent_fleet: Fleet };\n\t"modify" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n\n\t# Fleet Viewers can list IP Pools\n\t"list_children" if "viewer" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", ip_pool_list: IpPoolList)\n\tif ip_pool_list.fleet = fleet;\n\n# Any authenticated user can create a child of a provided IP Pool.\n# This is necessary to use the pools when provisioning instances.\nhas_permission(actor: AuthenticatedActor, "create_child", ip_pool: IpPool)\n\tif silo in actor.silo and silo.fleet = ip_pool.fleet;\n\n# Describes the policy for creating and managing web console sessions.\nresource ConsoleSessionList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: ConsoleSessionList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing device authorization requests.\nresource DeviceAuthRequestList {\n\tpermissions = [ "create_child" ];\n\trelations = { parent_fleet: Fleet };\n\t"create_child" if "external-authenticator" on "parent_fleet";\n}\nhas_relation(fleet: Fleet, "parent_fleet", collection: DeviceAuthRequestList)\n\tif collection.fleet = fleet;\n\n# Describes the policy for creating and managing Silo certificates\nresource SiloCertificateList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Both Fleet and Silo administrators can see and modify the Silo's\n\t# certificates.\n\t"list_children" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloCertificateList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloCertificateList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo identity providers\nresource SiloIdentityProviderList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the identity providers in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's identity provider\n\t# configuration. This is one of the only areas of Silo configuration\n\t# that Fleet Administrators have permissions on. This is also one of\n\t# the only cases where we need to look two levels up the hierarchy to\n\t# see if somebody has the right permission. For most other things,\n\t# permissions cascade down the hierarchy so we only need to look at the\n\t# parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloIdentityProviderList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloIdentityProviderList)\n\tif collection.silo.fleet = fleet;\n\n# Describes the policy for creating and managing Silo users (mostly intended for\n# API-managed users)\nresource SiloUserList {\n\tpermissions = [ "list_children", "create_child" ];\n\n\trelations = { parent_silo: Silo, parent_fleet: Fleet };\n\n\t# Everyone who can read the Silo (which includes all the users in the\n\t# Silo) can see the users in it.\n\t"list_children" if "read" on "parent_silo";\n\n\t# Fleet and Silo administrators can manage the Silo's users. This is\n\t# one of the only areas of Silo configuration that Fleet Administrators\n\t# have permissions on. This is also one of the few cases (so far) where\n\t# we need to look two levels up the hierarchy to see if somebody has the\n\t# right permission. For most other things, permissions cascade down the\n\t# hierarchy so we only need to look at the parent.\n\t"create_child" if "admin" on "parent_silo";\n\t"list_children" if "admin" on "parent_fleet";\n\t"create_child" if "admin" on "parent_fleet";\n}\nhas_relation(silo: Silo, "parent_silo", collection: SiloUserList)\n\tif collection.silo = silo;\nhas_relation(fleet: Fleet, "parent_fleet", collection: SiloUserList)\n\tif collection.silo.fleet = fleet;\n\n# These rules grants the external authenticator role the permissions it needs to\n# read silo users and modify their sessions. This is necessary for login to\n# work.\nhas_permission(actor: AuthenticatedActor, "read", silo: Silo)\n\tif has_role(actor, "external-authenticator", silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", user: SiloUser)\n\tif has_role(actor, "external-authenticator", user.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "read", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", group: SiloGroup)\n\tif has_role(actor, "external-authenticator", group.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\nhas_permission(actor: AuthenticatedActor, "modify", session: ConsoleSession)\n\tif has_role(actor, "external-authenticator", session.fleet);\n\n# All authenticated users can read and delete device authn requests because\n# by necessity these operations happen before we've figured out what user (or\n# even Silo) the device auth is associated with. Any user can claim a device\n# auth request with the right user code (that's how it works) -- it's the user\n# code and associated logic that prevents unauthorized access here.\nhas_permission(_actor: AuthenticatedActor, "read", _device_auth: DeviceAuthRequest);\nhas_permission(_actor: AuthenticatedActor, "modify", _device_auth: DeviceAuthRequest);\n\nhas_permission(actor: AuthenticatedActor, "read", device_token: DeviceAccessToken)\n\tif has_role(actor, "external-authenticator", device_token.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", identity_provider: IdentityProvider)\n\tif has_role(actor, "external-authenticator", identity_provider.silo.fleet);\n\nhas_permission(actor: AuthenticatedActor, "read", saml_identity_provider: SamlIdentityProvider)\n\tif has_role(actor, "external-authenticator", saml_identity_provider.silo.fleet);\n\n# Describes the policy for who can access the internal database.\nresource Database {\n\tpermissions = [\n\t # "query" is required to perform any query against the database,\n\t # whether a read or write query. This is checked when an operation\n\t # checks out a database connection from the connection pool.\n\t #\n\t # Any authenticated user gets this permission. There's generally\n\t # some other authz check involved in the database query. For\n\t # example, if you're querying the database to "read" a "Project", we\n\t # should also be checking that. So why do we do this at all? It's\n\t # a belt-and-suspenders measure so that if we somehow introduced an\n\t # unauthenticated code path that hits the database, it cannot be\n\t # used to DoS the database because we won't allow the operation to\n\t # make the query. (As long as the code path _is_ authenticated, we\n\t # can use throttling mechanisms to prevent DoS.)\n\t "query",\n\n\t # "modify" is required to populate database data that's delivered\n\t # with the system. It should also be required for schema changes,\n\t # when we support those. This is separate from "query" so that we\n\t # cannot accidentally invoke these code paths from API calls and\n\t # other general functions.\n\t "modify"\n\t];\n}\n\n# All authenticated users have the "query" permission on the database.\nhas_permission(_actor: AuthenticatedActor, "query", _resource: Database);\n\n# The "db-init" user is the only one with the "modify" permission.\nhas_permission(USER_DB_INIT: AuthenticatedActor, "modify", _resource: Database);\nhas_permission(USER_DB_INIT: AuthenticatedActor, "create_child", _resource: IpPoolList);\n# It also has "admin" on the internal silo to populate it with built-in resources.\n# TODO-completeness: actually limit to just internal silo and not all silos\nhas_role(USER_DB_INIT: AuthenticatedActor, "admin", _silo: Silo);\n\n# Allow the internal API admin permissions on all silos.\nhas_role(USER_INTERNAL_API: AuthenticatedActor, "admin", _silo: Silo);\n\n\n\n resource Disk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Disk)\n if child.project = parent;\n \n\n resource Snapshot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Snapshot)\n if child.project = parent;\n \n\n resource ProjectImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: ProjectImage)\n if child.project = parent;\n \n\n resource Instance {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Instance)\n if child.project = parent;\n \n\n resource IpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: IpPool)\n if child.fleet = fleet;\n \n\n resource InstanceNetworkInterface {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Instance\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InstanceNetworkInterface)\n if has_relation(project, "containing_project", child.instance);\n\n has_relation(parent: Instance, "parent", child: InstanceNetworkInterface)\n if child.instance = parent;\n \n\n resource Vpc {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: Vpc)\n if child.project = parent;\n \n\n resource VpcRouter {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcRouter)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcRouter)\n if child.vpc = parent;\n \n\n resource InternetGateway {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGateway)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: InternetGateway)\n if child.vpc = parent;\n \n\n resource InternetGatewayIpPool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpPool)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpPool)\n if child.internet_gateway = parent;\n \n\n resource InternetGatewayIpAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: InternetGateway\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: InternetGatewayIpAddress)\n if has_relation(project, "containing_project", child.internet_gateway);\n\n has_relation(parent: InternetGateway, "parent", child: InternetGatewayIpAddress)\n if child.internet_gateway = parent;\n \n\n resource RouterRoute {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: VpcRouter\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: RouterRoute)\n if has_relation(project, "containing_project", child.vpc_router);\n\n has_relation(parent: VpcRouter, "parent", child: RouterRoute)\n if child.vpc_router = parent;\n \n\n resource VpcSubnet {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = {\n containing_project: Project,\n parent: Vpc\n };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(project: Project, "containing_project", child: VpcSubnet)\n if has_relation(project, "containing_project", child.vpc);\n\n has_relation(parent: Vpc, "parent", child: VpcSubnet)\n if child.vpc = parent;\n \n\n resource FloatingIp {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_project: Project };\n "list_children" if "viewer" on "containing_project";\n "read" if "viewer" on "containing_project";\n "modify" if "collaborator" on "containing_project";\n "create_child" if "collaborator" on "containing_project";\n }\n\n has_relation(parent: Project, "containing_project", child: FloatingIp)\n if child.project = parent;\n \n\n resource Image {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: Image)\n if child.silo = parent;\n \n\n resource SiloImage {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n\n relations = { containing_silo: Silo };\n "list_children" if "viewer" on "containing_silo";\n "read" if "viewer" on "containing_silo";\n "modify" if "collaborator" on "containing_silo";\n "create_child" if "collaborator" on "containing_silo";\n }\n\n has_relation(parent: Silo, "containing_silo", child: SiloImage)\n if child.silo = parent;\n \n\n resource AddressLot {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: AddressLot)\n if child.fleet = fleet;\n \n\n resource Blueprint {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Blueprint)\n if child.fleet = fleet;\n \n\n resource LoopbackAddress {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: LoopbackAddress)\n if child.fleet = fleet;\n \n\n\n resource ConsoleSession {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: ConsoleSession)\n if child.fleet = fleet;\n \n\n resource DeviceAuthRequest {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAuthRequest)\n if child.fleet = fleet;\n \n\n resource DeviceAccessToken {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: DeviceAccessToken)\n if child.fleet = fleet;\n \n\n resource PhysicalDisk {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: PhysicalDisk)\n if child.fleet = fleet;\n \n\n resource Rack {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Rack)\n if child.fleet = fleet;\n \n\n resource RoleBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: RoleBuiltin)\n if child.fleet = fleet;\n \n\n\n\n\n\n\n\n resource Sled {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Sled)\n if child.fleet = fleet;\n \n\n resource TufRepo {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufRepo)\n if child.fleet = fleet;\n \n\n resource TufArtifact {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: TufArtifact)\n if child.fleet = fleet;\n \n\n resource Zpool {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Zpool)\n if child.fleet = fleet;\n \n\n resource Service {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: Service)\n if child.fleet = fleet;\n \n\n resource UserBuiltin {\n permissions = [\n "list_children",\n "modify",\n "read",\n "create_child",\n ];\n \n relations = { parent_fleet: Fleet };\n "list_children" if "viewer" on "parent_fleet";\n "read" if "viewer" on "parent_fleet";\n "modify" if "admin" on "parent_fleet";\n "create_child" if "admin" on "parent_fleet";\n }\n has_relation(fleet: Fleet, "parent_fleet", child: UserBuiltin)\n if child.fleet = fleet;\n file = nexus/auth/src/authz/oso_generic.rs:89
632024-12-12T22:34:22.735ZINFOnexus (ServerContext): Setting up resolver using DNS servers for subnet: Ipv6Subnet { net: Ipv6Net { addr: fd00:1122:3344::, width: 48 } } file = nexus/src/context.rs:219
642024-12-12T22:34:22.737ZINFOnexus (DnsResolver): new DNS resolver addresses = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = internal-dns/resolver/src/resolver.rs:111
652024-12-12T22:34:22.741ZINFOnexus (ServerContext): Setting up qorb database pool from DNS dns_addrs = [[fd00:1122:3344:1::1]:53, [fd00:1122:3344:2::1]:53, [fd00:1122:3344:3::1]:53] file = nexus/src/context.rs:275
662024-12-12T22:34:22.747ZDEBGnexus (ServerContext): registered USDT probes
672024-12-12T22:34:22.976ZINFOnexus: Database schema version is up to date desired_version = 116.0.0 file = nexus/db-queries/src/db/datastore/db_metadata.rs:145 found_version = 116.0.0
682024-12-12T22:34:22.979ZINFOnexus (SEC): SEC running file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:813 sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
692024-12-12T22:34:22.979ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3393, tv_nsec: 901752480 } })
702024-12-12T22:34:22.980ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
712024-12-12T22:34:23.043ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
722024-12-12T22:34:23.043ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
732024-12-12T22:34:23.046ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "368db933-c91a-4b1a-bcd4-5d5380a0b729", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:23 GMT"} })
742024-12-12T22:34:23.046ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
752024-12-12T22:34:23.047ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
762024-12-12T22:34:23.077ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3393, tv_nsec: 999675834 } })
772024-12-12T22:34:23.078ZINFOnexus (Nexus): Determining switch slots managed by switch zones file = nexus/src/app/mod.rs:1103
782024-12-12T22:34:23.110ZINFOnexus (Nexus): determining switch slot managed by dendrite zone file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
792024-12-12T22:34:23.110ZDEBGnexus (MgsClient): client request body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
802024-12-12T22:34:23.110ZDEBGnexus (MgsClient): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a3e17e76-7ac1-4ad5-ae30-9b384ab3198e", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:23 GMT"} })
812024-12-12T22:34:23.110ZINFOnexus (Nexus): identified switch slot for dendrite zone file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
822024-12-12T22:34:23.110ZINFOnexus (Nexus): completed mapping dendrite zones to switch slots file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
832024-12-12T22:34:23.177ZDEBGnexus (clickhouse-client): registered USDT probes id = 72a73143-a258-40fe-b269-6eef8bb19cd5
842024-12-12T22:34:23.185ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
852024-12-12T22:34:23.196ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
862024-12-12T22:34:23.197ZDEBGnexus (DataLoader): attempting to create built-in users
872024-12-12T22:34:23.197ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
882024-12-12T22:34:23.197ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
892024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /artifacts/{kind}/{name}/{version} versions = all
902024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks versions = all
912024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /bgtasks/activate versions = all
922024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /bgtasks/view/{bgtask_name} versions = all
932024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /clickhouse/policy versions = all
942024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /clickhouse/policy versions = all
952024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stop-request versions = all
962024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/downstairs/{downstairs_id}/stopped versions = all
972024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair/{repair_id}/progress versions = all
982024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-finish versions = all
992024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /crucible/0/upstairs/{upstairs_id}/repair-start versions = all
1002024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga versions = all
1012024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /demo-saga/{demo_saga_id}/complete versions = all
1022024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all versions = all
1032024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = DELETE path = /deployment/blueprints/all/{blueprint_id} versions = all
1042024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/all/{blueprint_id} versions = all
1052024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/import versions = all
1062024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/regenerate versions = all
1072024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /deployment/blueprints/target versions = all
1082024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /deployment/blueprints/target versions = all
1092024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /deployment/blueprints/target/enabled versions = all
1102024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /disk/{disk_id}/remove-read-only-parent versions = all
1112024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /disks/{disk_id} versions = all
1122024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /instances/{instance_id}/migrate versions = all
1132024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/collectors versions = all
1142024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /metrics/collectors/{collector_id}/producers versions = all
1152024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /metrics/producers versions = all
1162024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /nat/ipv4/changeset/{from_gen} versions = all
1172024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /physical-disk/expunge versions = all
1182024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /probes/{sled} versions = all
1192024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /racks/{rack_id}/initialization-complete versions = all
1202024-12-12T22:34:23.213ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas versions = all
1212024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sagas/{saga_id} versions = all
1222024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sled-agents/{sled_id} versions = all
1232024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id} versions = all
1242024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sled-agents/{sled_id}/firewall-rules-update versions = all
1252024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/add versions = all
1262024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /sleds/expunge versions = all
1272024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = GET path = /sleds/uninitialized versions = all
1282024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /switch/{switch_id} versions = all
1292024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = PUT path = /vmms/{propolis_id} versions = all
1302024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): registered endpoint local_addr = [fd00:1122:3344:101::c]:12221 method = POST path = /volume/{volume_id}/remove-read-only-parent versions = all
1312024-12-12T22:34:23.214ZINFOnexus (dropshot_internal): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12221
1322024-12-12T22:34:23.214ZDEBGnexus (dropshot_internal): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12221
1332024-12-12T22:34:23.214ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
1342024-12-12T22:34:23.214ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
1352024-12-12T22:34:23.303ZWARNnexus: Cannot look up rack: Object (of type ById(ceaea472-35b2-490f-a91b-ab350691945c)) not found: rack file = nexus/src/app/rack.rs:774
1362024-12-12T22:34:23.313ZINFOnexus (DataLoader): created 5 built-in users file = nexus/db-queries/src/db/datastore/silo_user.rs:394
1372024-12-12T22:34:23.313ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1382024-12-12T22:34:23.314ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1392024-12-12T22:34:23.315ZDEBGnexus (DataLoader): attempting to create built-in roles
1402024-12-12T22:34:23.315ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1412024-12-12T22:34:23.315ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1422024-12-12T22:34:23.338ZINFOnexus (DataLoader): created 10 built-in roles file = nexus/db-queries/src/db/datastore/role.rs:85
1432024-12-12T22:34:23.338ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1442024-12-12T22:34:23.339ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1452024-12-12T22:34:23.339ZDEBGnexus (DataLoader): attempting to create built-in role assignments
1462024-12-12T22:34:23.339ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1472024-12-12T22:34:23.340ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1482024-12-12T22:34:23.567ZINFOnexus (DataLoader): created 4 built-in role assignments file = nexus/db-queries/src/db/datastore/role.rs:114
1492024-12-12T22:34:23.567ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1502024-12-12T22:34:23.569ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1512024-12-12T22:34:23.569ZDEBGnexus (DataLoader): attempting to create built-in silos
1522024-12-12T22:34:23.569ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1532024-12-12T22:34:23.569ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1542024-12-12T22:34:23.656ZINFOnexus (DataLoader): created 2 built-in silos file = nexus/db-queries/src/db/datastore/silo.rs:94
1552024-12-12T22:34:23.656ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1562024-12-12T22:34:23.657ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1572024-12-12T22:34:23.697ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:38445
1582024-12-12T22:34:23.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1592024-12-12T22:34:23.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1602024-12-12T22:34:23.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1612024-12-12T22:34:23.724ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1622024-12-12T22:34:23.724ZDEBGnexus (DataLoader): attempting to create built-in projects
1632024-12-12T22:34:23.724ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1642024-12-12T22:34:23.724ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1652024-12-12T22:34:23.748ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1662024-12-12T22:34:23.748ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1672024-12-12T22:34:24.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1682024-12-12T22:34:24.019ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1692024-12-12T22:34:24.019ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1702024-12-12T22:34:24.021ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1712024-12-12T22:34:24.024ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1722024-12-12T22:34:24.024ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1732024-12-12T22:34:24.099ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1742024-12-12T22:34:24.100ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1752024-12-12T22:34:24.303ZINFOnexus (dropshot_internal): set cockroachdb setting actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/cockroachdb_settings.rs:124 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 setting = cluster.preserve_downgrade_option uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete value = 22.1
1762024-12-12T22:34:24.303ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1772024-12-12T22:34:24.304ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1782024-12-12T22:34:24.308ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "ceaea472-35b2-490f-a91b-ab350691945c" error_message_internal = not found: rack with id "ceaea472-35b2-490f-a91b-ab350691945c" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 609992 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 3980b87d-e184-4c94-b270-2b23bc414597 response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
1792024-12-12T22:34:24.481ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1802024-12-12T22:34:24.483ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1812024-12-12T22:34:24.483ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1822024-12-12T22:34:24.483ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1832024-12-12T22:34:24.514ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1842024-12-12T22:34:24.515ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1852024-12-12T22:34:24.516ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1862024-12-12T22:34:24.518ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) } result = Ok(())
1872024-12-12T22:34:24.518ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1882024-12-12T22:34:24.519ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1892024-12-12T22:34:24.583ZINFOnexus (DataLoader): created built-in services project file = nexus/db-queries/src/db/datastore/project.rs:122
1902024-12-12T22:34:24.583ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1912024-12-12T22:34:24.584ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1922024-12-12T22:34:24.584ZDEBGnexus (DataLoader): attempting to create built-in VPCs
1932024-12-12T22:34:24.584ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1942024-12-12T22:34:24.584ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1952024-12-12T22:34:24.594ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1962024-12-12T22:34:24.594ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1972024-12-12T22:34:24.624ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
1982024-12-12T22:34:24.624ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
1992024-12-12T22:34:24.668ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2002024-12-12T22:34:24.668ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2012024-12-12T22:34:24.882ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2022024-12-12T22:34:24.883ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2032024-12-12T22:34:24.918ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2042024-12-12T22:34:24.921ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2052024-12-12T22:34:24.921ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2062024-12-12T22:34:24.921ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2072024-12-12T22:34:24.922ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2082024-12-12T22:34:24.923ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2092024-12-12T22:34:24.923ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2102024-12-12T22:34:24.924ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2112024-12-12T22:34:24.925ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2122024-12-12T22:34:24.928ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) } result = Ok(())
2132024-12-12T22:34:24.928ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2142024-12-12T22:34:24.928ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2152024-12-12T22:34:24.989ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2162024-12-12T22:34:24.989ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2172024-12-12T22:34:24.991ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2182024-12-12T22:34:24.991ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2192024-12-12T22:34:24.995ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2202024-12-12T22:34:24.995ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2212024-12-12T22:34:24.996ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2222024-12-12T22:34:24.999ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2232024-12-12T22:34:24.999ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2242024-12-12T22:34:24.999ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2252024-12-12T22:34:25.031ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2262024-12-12T22:34:25.031ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2272024-12-12T22:34:25.040ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2282024-12-12T22:34:25.040ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2292024-12-12T22:34:25.050ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2302024-12-12T22:34:25.050ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2312024-12-12T22:34:25.051ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2322024-12-12T22:34:25.051ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2332024-12-12T22:34:25.052ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2342024-12-12T22:34:25.053ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2352024-12-12T22:34:25.054ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2362024-12-12T22:34:25.057ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") } result = Ok(())
2372024-12-12T22:34:25.057ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2382024-12-12T22:34:25.057ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2392024-12-12T22:34:25.090ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2402024-12-12T22:34:25.090ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2412024-12-12T22:34:25.091ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2422024-12-12T22:34:25.092ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2432024-12-12T22:34:25.093ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2442024-12-12T22:34:25.093ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2452024-12-12T22:34:25.094ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2462024-12-12T22:34:25.097ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2472024-12-12T22:34:25.097ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2482024-12-12T22:34:25.097ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2492024-12-12T22:34:25.204ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2502024-12-12T22:34:25.204ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2512024-12-12T22:34:25.207ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2522024-12-12T22:34:25.207ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2532024-12-12T22:34:25.209ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2542024-12-12T22:34:25.209ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2552024-12-12T22:34:25.212ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2562024-12-12T22:34:25.217ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
2572024-12-12T22:34:25.217ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2582024-12-12T22:34:25.217ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2592024-12-12T22:34:25.305ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
2602024-12-12T22:34:25.305ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
2612024-12-12T22:34:25.307ZWARNnexus: Cannot look up rack: Object (of type ById(ceaea472-35b2-490f-a91b-ab350691945c)) not found: rack file = nexus/src/app/rack.rs:774
2622024-12-12T22:34:25.312ZDEBGnexus (DataLoader): attempting to create built-in VPC firewall rules
2632024-12-12T22:34:25.312ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2642024-12-12T22:34:25.312ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2652024-12-12T22:34:25.323ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2662024-12-12T22:34:25.323ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2672024-12-12T22:34:25.331ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2682024-12-12T22:34:25.331ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2692024-12-12T22:34:25.333ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2702024-12-12T22:34:25.333ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2712024-12-12T22:34:25.335ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2722024-12-12T22:34:25.335ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2732024-12-12T22:34:25.360ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2742024-12-12T22:34:25.360ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2752024-12-12T22:34:25.362ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2762024-12-12T22:34:25.365ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2772024-12-12T22:34:25.365ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2782024-12-12T22:34:25.366ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2792024-12-12T22:34:25.393ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2802024-12-12T22:34:25.393ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2812024-12-12T22:34:25.395ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2822024-12-12T22:34:25.395ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2832024-12-12T22:34:25.396ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2842024-12-12T22:34:25.400ZDEBGnexus (DataLoader): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2852024-12-12T22:34:25.400ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2862024-12-12T22:34:25.400ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2872024-12-12T22:34:25.413ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2882024-12-12T22:34:25.414ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2892024-12-12T22:34:25.415ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2902024-12-12T22:34:25.415ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2912024-12-12T22:34:25.416ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2922024-12-12T22:34:25.417ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2932024-12-12T22:34:25.418ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2942024-12-12T22:34:25.422ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
2952024-12-12T22:34:25.422ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
2962024-12-12T22:34:25.422ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
2972024-12-12T22:34:25.508ZINFOnexus (DataLoader): created built-in VPC firewall rules file = nexus/db-queries/src/db/datastore/vpc.rs:282
2982024-12-12T22:34:25.508ZDEBGnexus (DataLoader): attempting to create built-in VPC Subnets
2992024-12-12T22:34:25.508ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3002024-12-12T22:34:25.509ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3012024-12-12T22:34:25.523ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3022024-12-12T22:34:25.523ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3032024-12-12T22:34:25.524ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3042024-12-12T22:34:25.525ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3052024-12-12T22:34:25.526ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3062024-12-12T22:34:25.527ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3072024-12-12T22:34:25.528ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3082024-12-12T22:34:25.528ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3092024-12-12T22:34:25.530ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3102024-12-12T22:34:25.530ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3112024-12-12T22:34:25.531ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3122024-12-12T22:34:25.534ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3132024-12-12T22:34:25.534ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3142024-12-12T22:34:25.534ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3152024-12-12T22:34:25.537ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3162024-12-12T22:34:25.537ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3172024-12-12T22:34:25.538ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3182024-12-12T22:34:25.538ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3192024-12-12T22:34:25.540ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3202024-12-12T22:34:25.540ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3212024-12-12T22:34:25.541ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3222024-12-12T22:34:25.543ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3232024-12-12T22:34:25.543ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3242024-12-12T22:34:25.544ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3252024-12-12T22:34:25.544ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3262024-12-12T22:34:25.545ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3272024-12-12T22:34:25.545ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3282024-12-12T22:34:25.546ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3292024-12-12T22:34:25.564ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3302024-12-12T22:34:25.564ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3312024-12-12T22:34:25.579ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3322024-12-12T22:34:25.579ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3332024-12-12T22:34:25.581ZINFOnexus (dropshot_internal): request completed error_message_external = not found: rack with id "ceaea472-35b2-490f-a91b-ab350691945c" error_message_internal = not found: rack with id "ceaea472-35b2-490f-a91b-ab350691945c" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 38613 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 107f0b37-839c-485c-aabb-af126946dd11 response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
3342024-12-12T22:34:25.639ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3352024-12-12T22:34:25.639ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3362024-12-12T22:34:25.647ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3372024-12-12T22:34:25.648ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3382024-12-12T22:34:25.650ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3392024-12-12T22:34:25.650ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3402024-12-12T22:34:25.652ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3412024-12-12T22:34:25.652ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3422024-12-12T22:34:25.654ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3432024-12-12T22:34:25.658ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3442024-12-12T22:34:25.658ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3452024-12-12T22:34:25.658ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3462024-12-12T22:34:25.676ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3472024-12-12T22:34:25.676ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3482024-12-12T22:34:25.678ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3492024-12-12T22:34:25.678ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3502024-12-12T22:34:25.680ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3512024-12-12T22:34:25.680ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3522024-12-12T22:34:25.682ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3532024-12-12T22:34:25.682ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3542024-12-12T22:34:25.684ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3552024-12-12T22:34:25.687ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3562024-12-12T22:34:25.709ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3572024-12-12T22:34:25.709ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3582024-12-12T22:34:25.723ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3592024-12-12T22:34:25.723ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3602024-12-12T22:34:25.727ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3612024-12-12T22:34:25.727ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3622024-12-12T22:34:25.729ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3632024-12-12T22:34:25.729ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3642024-12-12T22:34:25.731ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3652024-12-12T22:34:25.731ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3662024-12-12T22:34:25.732ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3672024-12-12T22:34:25.735ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3682024-12-12T22:34:25.735ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3692024-12-12T22:34:25.736ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3702024-12-12T22:34:25.771ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3712024-12-12T22:34:25.771ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3722024-12-12T22:34:25.772ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3732024-12-12T22:34:25.773ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3742024-12-12T22:34:25.774ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3752024-12-12T22:34:25.774ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3762024-12-12T22:34:25.776ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3772024-12-12T22:34:25.776ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3782024-12-12T22:34:25.777ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3792024-12-12T22:34:25.780ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
3802024-12-12T22:34:25.786ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3812024-12-12T22:34:25.786ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3822024-12-12T22:34:25.856ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3832024-12-12T22:34:25.857ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3842024-12-12T22:34:25.865ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3852024-12-12T22:34:25.865ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3862024-12-12T22:34:25.868ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3872024-12-12T22:34:25.868ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3882024-12-12T22:34:25.869ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3892024-12-12T22:34:25.869ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3902024-12-12T22:34:25.871ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3912024-12-12T22:34:25.875ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
3922024-12-12T22:34:25.875ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3932024-12-12T22:34:25.875ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3942024-12-12T22:34:25.889ZINFOnexus (DataLoader): created built-in services vpc subnets file = nexus/db-queries/src/db/datastore/vpc.rs:346
3952024-12-12T22:34:25.889ZINFOnexus (DataLoader): created built-in services vpc file = nexus/db-queries/src/db/datastore/vpc.rs:224
3962024-12-12T22:34:25.889ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
3972024-12-12T22:34:25.890ZDEBGnexus (DataLoader): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
3982024-12-12T22:34:25.890ZDEBGnexus (DataLoader): attempting to create silo users
3992024-12-12T22:34:25.890ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4002024-12-12T22:34:25.891ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4012024-12-12T22:34:25.916ZINFOnexus (DataLoader): created 2 silo users file = nexus/db-queries/src/db/datastore/silo_user.rs:419
4022024-12-12T22:34:25.916ZDEBGnexus (DataLoader): attempting to create silo user role assignments
4032024-12-12T22:34:25.916ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4042024-12-12T22:34:25.917ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4052024-12-12T22:34:25.927ZINFOnexus (DataLoader): created 2 silo user role assignments file = nexus/db-queries/src/db/datastore/silo_user.rs:446
4062024-12-12T22:34:25.927ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4072024-12-12T22:34:25.927ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4082024-12-12T22:34:25.940ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4092024-12-12T22:34:25.940ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4102024-12-12T22:34:25.947ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4112024-12-12T22:34:25.947ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4122024-12-12T22:34:25.948ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4132024-12-12T22:34:25.950ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4142024-12-12T22:34:25.950ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4152024-12-12T22:34:25.950ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4162024-12-12T22:34:25.965ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4172024-12-12T22:34:25.965ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4182024-12-12T22:34:25.967ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4192024-12-12T22:34:25.968ZDEBGnexus (DataLoader): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = IpPoolList result = Ok(())
4202024-12-12T22:34:25.968ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4212024-12-12T22:34:25.968ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4222024-12-12T22:34:26.095ZDEBGnexus (DataLoader): roles roles = RoleSet { roles: {} }
4232024-12-12T22:34:26.096ZDEBGnexus (DataLoader): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000001, .. }) resource = Database result = Ok(())
4242024-12-12T22:34:26.100ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:51517
4252024-12-12T22:34:26.102ZINFOnexus: populate complete file = nexus/src/app/mod.rs:527
4262024-12-12T22:34:26.102ZINFOnexus: activating background tasks file = nexus/src/app/mod.rs:536
4272024-12-12T22:34:26.102ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51517 req_id = 04b2cc05-3003-4587-a705-cde35d2fcd7f roles = RoleSet { roles: {} } uri = /metrics/producers
4282024-12-12T22:34:26.103ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51517 req_id = 04b2cc05-3003-4587-a705-cde35d2fcd7f resource = Database result = Ok(()) uri = /metrics/producers
4292024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 1 reason = Timeout
4302024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 1 reason = Timeout
4312024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 1 reason = Timeout
4322024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 1 reason = Timeout
4332024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 1 reason = Timeout
4342024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 1 reason = Timeout
4352024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 1 reason = Timeout
4362024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 1 reason = Timeout
4372024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 1 reason = Timeout
4382024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 1 reason = Timeout
4392024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 1 reason = Timeout
4402024-12-12T22:34:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = crdb_node_id_collector file = nexus/src/app/background/tasks/crdb_node_id_collector.rs:78 reason = no blueprint
4412024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
4422024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 1 reason = Timeout
4432024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 1 reason = Timeout
4442024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
4452024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 1 reason = Timeout
4462024-12-12T22:34:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
4472024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 1 reason = Timeout
4482024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 1 reason = Timeout
4492024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
4502024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
4512024-12-12T22:34:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:74 reason = no blueprint
4522024-12-12T22:34:26.105ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4532024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
4542024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
4552024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 1 reason = Timeout
4562024-12-12T22:34:26.105ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:61 reason = no config nor servers
4572024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
4582024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
4592024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 1 reason = Timeout
4602024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
4612024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
4622024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
4632024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
4642024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 1 reason = Timeout
4652024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 1 reason = Timeout
4662024-12-12T22:34:26.105ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
4672024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 1 reason = Timeout
4682024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 1 reason = Timeout
4692024-12-12T22:34:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
4702024-12-12T22:34:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:24:26.105780845 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
4712024-12-12T22:34:26.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
4722024-12-12T22:34:26.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
4732024-12-12T22:34:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 213.024\u{b5}s iteration = 1 status = {"error":"no config nor servers"}
4742024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 1.690023ms iteration = 1 status = {"error":"no config nor servers"}
4752024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 1.694853ms iteration = 1 status = {"error":"no blueprint"}
4762024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 1 reason = Timeout
4772024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 1 reason = Timeout
4782024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 1 reason = Timeout
4792024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 178.324\u{b5}s iteration = 1 status = {"error":"no blueprint"}
4802024-12-12T22:34:26.107ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
4812024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 1 reason = Timeout
4822024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 1 reason = Timeout
4832024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 1 reason = Timeout
4842024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
4852024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
4862024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 1 reason = Timeout
4872024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
4882024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
4892024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
4902024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 1 reason = Timeout
4912024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
4922024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
4932024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 1 reason = Timeout
4942024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 1 reason = Timeout
4952024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
4962024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
4972024-12-12T22:34:26.107ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
4982024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
4992024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 1 reason = Timeout
5002024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
5012024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
5022024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 1 reason = Timeout
5032024-12-12T22:34:26.108ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
5042024-12-12T22:34:26.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
5052024-12-12T22:34:26.108ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
5062024-12-12T22:34:26.109ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
5072024-12-12T22:34:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5082024-12-12T22:34:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
5092024-12-12T22:34:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5102024-12-12T22:34:26.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5112024-12-12T22:34:26.110ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3397, tv_nsec: 32592209 } })
5122024-12-12T22:34:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
5132024-12-12T22:34:26.111ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3397, tv_nsec: 32742182 } })
5142024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
5152024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
5162024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
5172024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5182024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
5192024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5202024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
5212024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5222024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
5232024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5242024-12-12T22:34:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
5252024-12-12T22:34:26.112ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external dns_group = external file = nexus/src/app/background/tasks/dns_servers.rs:113
5262024-12-12T22:34:26.112ZINFOnexus (BackgroundTasks): found DNS servers (initial) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal dns_group = internal file = nexus/src/app/background/tasks/dns_servers.rs:113
5272024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 6.831824ms iteration = 1 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
5282024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 6.874465ms iteration = 1 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
5292024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 2 reason = Dependency
5302024-12-12T22:34:26.112ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5312024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 2.78\u{b5}s iteration = 2 status = {"error":"no config"}
5322024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 2 reason = Dependency
5332024-12-12T22:34:26.112ZWARNnexus (BackgroundTasks): DNS propagation: skipped background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:69 reason = no config
5342024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 4.56\u{b5}s iteration = 2 status = {"error":"no config"}
5352024-12-12T22:34:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5362024-12-12T22:34:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
5372024-12-12T22:34:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5382024-12-12T22:34:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
5392024-12-12T22:34:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5402024-12-12T22:34:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
5412024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
5422024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
5432024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
5442024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
5452024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
5462024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
5472024-12-12T22:34:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
5482024-12-12T22:34:26.114ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
5492024-12-12T22:34:26.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3397, tv_nsec: 37825331 } })
5502024-12-12T22:34:26.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
5512024-12-12T22:34:26.117ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 11.482335ms iteration = 1 status = {"errors":[],"found_port_ok":[]}
5522024-12-12T22:34:26.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5532024-12-12T22:34:26.121ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
5542024-12-12T22:34:26.121ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
5552024-12-12T22:34:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
5562024-12-12T22:34:26.125ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
5572024-12-12T22:34:26.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
5582024-12-12T22:34:26.134ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:24:26.105780845 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
5592024-12-12T22:34:26.134ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 28.724374ms iteration = 1 status = {"expiration":"2024-12-12T22:24:26.105780845Z","pruned":[]}
5602024-12-12T22:34:26.137ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 32.391047ms iteration = 1 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
5612024-12-12T22:34:26.156ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
5622024-12-12T22:34:26.156ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
5632024-12-12T22:34:26.156ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "663dd7d1-3e3f-4063-95df-9e0238067204", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
5642024-12-12T22:34:26.156ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
5652024-12-12T22:34:26.158ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
5662024-12-12T22:34:26.166ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5672024-12-12T22:34:26.167ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5682024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
5692024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
5702024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
5712024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
5722024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
5732024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
5742024-12-12T22:34:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
5752024-12-12T22:34:26.171ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5762024-12-12T22:34:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
5772024-12-12T22:34:26.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5782024-12-12T22:34:26.172ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5792024-12-12T22:34:26.172ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5802024-12-12T22:34:26.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5812024-12-12T22:34:26.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
5822024-12-12T22:34:26.174ZINFOnexus (dropshot_internal): request completed error_message_external = Service Unavailable error_message_internal = no Oximeter instances available for assignment file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 73072 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:51517 req_id = 04b2cc05-3003-4587-a705-cde35d2fcd7f response_code = 503 uri = /metrics/producers
5832024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
5842024-12-12T22:34:26.175ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
5852024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.305591ms iteration = 1 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
5862024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
5872024-12-12T22:34:26.175ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
5882024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
5892024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
5902024-12-12T22:34:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
5912024-12-12T22:34:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
5922024-12-12T22:34:26.176ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
5932024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
5942024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
5952024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
5962024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
5972024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
5982024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
5992024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
6002024-12-12T22:34:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
6012024-12-12T22:34:26.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6022024-12-12T22:34:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
6032024-12-12T22:34:26.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
6042024-12-12T22:34:26.178ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6052024-12-12T22:34:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
6062024-12-12T22:34:26.180ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3397, tv_nsec: 101857759 } })
6072024-12-12T22:34:26.180ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
6082024-12-12T22:34:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
6092024-12-12T22:34:26.181ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
6102024-12-12T22:34:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
6112024-12-12T22:34:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
6122024-12-12T22:34:26.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
6132024-12-12T22:34:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
6142024-12-12T22:34:26.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
6152024-12-12T22:34:26.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6162024-12-12T22:34:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
6172024-12-12T22:34:26.186ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6182024-12-12T22:34:26.186ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
6192024-12-12T22:34:26.186ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
6202024-12-12T22:34:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
6212024-12-12T22:34:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6222024-12-12T22:34:26.188ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6232024-12-12T22:34:26.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
6242024-12-12T22:34:26.197ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6252024-12-12T22:34:26.197ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 91.778663ms iteration = 1 status = {}
6262024-12-12T22:34:26.197ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
6272024-12-12T22:34:26.197ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 92.006998ms iteration = 1 status = {"error":"rack not yet initialized: ceaea472-35b2-490f-a91b-ab350691945c"}
6282024-12-12T22:34:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6292024-12-12T22:34:26.199ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6302024-12-12T22:34:26.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6312024-12-12T22:34:26.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6322024-12-12T22:34:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 96.208039ms iteration = 1 status = {}
6332024-12-12T22:34:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
6342024-12-12T22:34:26.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
6352024-12-12T22:34:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
6362024-12-12T22:34:26.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6372024-12-12T22:34:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6382024-12-12T22:34:26.212ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6392024-12-12T22:34:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6402024-12-12T22:34:26.214ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
6412024-12-12T22:34:26.214ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.49337ms iteration = 1 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
6422024-12-12T22:34:26.214ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6432024-12-12T22:34:26.217ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_external dns_group = external error = Internal Error: expected exactly one latest version for DNS group External, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6442024-12-12T22:34:26.217ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 112.371267ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group External, found 0"}
6452024-12-12T22:34:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6462024-12-12T22:34:26.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6472024-12-12T22:34:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6482024-12-12T22:34:26.219ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6492024-12-12T22:34:26.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6502024-12-12T22:34:26.221ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6512024-12-12T22:34:26.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6522024-12-12T22:34:26.222ZWARNnexus (BackgroundTasks): failed to read DNS config background_task = dns_config_internal dns_group = internal error = Internal Error: expected exactly one latest version for DNS group Internal, found 0 file = nexus/src/app/background/tasks/dns_config.rs:72
6532024-12-12T22:34:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 116.890325ms iteration = 1 status = {"error":"failed to read DNS config: Internal Error: expected exactly one latest version for DNS group Internal, found 0"}
6542024-12-12T22:34:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 116.61935ms iteration = 1 status = {"errors":[],"garbage_collect_requested":[]}
6552024-12-12T22:34:26.222ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6562024-12-12T22:34:26.225ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
6572024-12-12T22:34:26.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
6582024-12-12T22:34:26.227ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6592024-12-12T22:34:26.227ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6602024-12-12T22:34:26.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6612024-12-12T22:34:26.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
6622024-12-12T22:34:26.229ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
6632024-12-12T22:34:26.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 123.739801ms iteration = 1 status = {"errors":[],"records_set_to_done":[]}
6642024-12-12T22:34:26.229ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "06e430f0-45e9-4826-94e4-f6b72b930725", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
6652024-12-12T22:34:26.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
6662024-12-12T22:34:26.230ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
6672024-12-12T22:34:26.230ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6682024-12-12T22:34:26.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6692024-12-12T22:34:26.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6702024-12-12T22:34:26.233ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
6712024-12-12T22:34:26.233ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
6722024-12-12T22:34:26.233ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
6732024-12-12T22:34:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6742024-12-12T22:34:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
6752024-12-12T22:34:26.234ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6762024-12-12T22:34:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6772024-12-12T22:34:26.236ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6782024-12-12T22:34:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6792024-12-12T22:34:26.237ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
6802024-12-12T22:34:26.237ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 131.674027ms iteration = 1 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":0,"recent_failures":[],"recent_recoveries":[]}
6812024-12-12T22:34:26.237ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 132.185436ms iteration = 1 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
6822024-12-12T22:34:26.238ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6832024-12-12T22:34:26.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6842024-12-12T22:34:26.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6852024-12-12T22:34:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6862024-12-12T22:34:26.245ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
6872024-12-12T22:34:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
6882024-12-12T22:34:26.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
6892024-12-12T22:34:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
6902024-12-12T22:34:26.250ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6912024-12-12T22:34:26.250ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6922024-12-12T22:34:26.251ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 145.311894ms iteration = 1 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
6932024-12-12T22:34:26.254ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6942024-12-12T22:34:26.255ZWARNnexus (BackgroundTasks): failed to read Silo/DNS/TLS configuration background_task = external_endpoints error = Internal Error: expected at least one external DNS zone file = nexus/src/app/background/tasks/external_endpoints.rs:48
6952024-12-12T22:34:26.255ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 149.771302ms iteration = 1 status = {"error":"failed to read Silo/DNS/TLS configuration: Internal Error: expected at least one external DNS zone"}
6962024-12-12T22:34:26.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
6972024-12-12T22:34:26.259ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
6982024-12-12T22:34:26.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
6992024-12-12T22:34:26.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
7002024-12-12T22:34:26.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7012024-12-12T22:34:26.259ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
7022024-12-12T22:34:26.260ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 154.405163ms iteration = 1 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
7032024-12-12T22:34:26.261ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
7042024-12-12T22:34:26.261ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
7052024-12-12T22:34:26.261ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 155.340851ms iteration = 1 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
7062024-12-12T22:34:26.262ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7072024-12-12T22:34:26.262ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7082024-12-12T22:34:26.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7092024-12-12T22:34:26.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7102024-12-12T22:34:26.266ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7112024-12-12T22:34:26.267ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
7122024-12-12T22:34:26.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7132024-12-12T22:34:26.267ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "52b61972-87bd-470d-94cb-de5e52eb67f6", "content-length": "1", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
7142024-12-12T22:34:26.268ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
7152024-12-12T22:34:26.268ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7162024-12-12T22:34:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
7172024-12-12T22:34:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7182024-12-12T22:34:26.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7192024-12-12T22:34:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7202024-12-12T22:34:26.270ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7212024-12-12T22:34:26.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7222024-12-12T22:34:26.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7232024-12-12T22:34:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7242024-12-12T22:34:26.276ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7252024-12-12T22:34:26.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7262024-12-12T22:34:26.280ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 175.415965ms iteration = 1 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
7272024-12-12T22:34:26.282ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 176.987316ms iteration = 1 status = null
7282024-12-12T22:34:26.293ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 187.817499ms iteration = 1 status = {}
7292024-12-12T22:34:26.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.615724ms iteration = 1 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
7302024-12-12T22:34:26.297ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
7312024-12-12T22:34:26.297ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
7322024-12-12T22:34:26.297ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 192.172795ms iteration = 1 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
7332024-12-12T22:34:26.312ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7342024-12-12T22:34:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7352024-12-12T22:34:26.318ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7362024-12-12T22:34:26.322ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
7372024-12-12T22:34:26.322ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7382024-12-12T22:34:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7392024-12-12T22:34:26.326ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7402024-12-12T22:34:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7412024-12-12T22:34:26.328ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7422024-12-12T22:34:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7432024-12-12T22:34:26.330ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7442024-12-12T22:34:26.331ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7452024-12-12T22:34:26.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7462024-12-12T22:34:26.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7472024-12-12T22:34:26.333ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7482024-12-12T22:34:26.333ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7492024-12-12T22:34:26.333ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7502024-12-12T22:34:26.334ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7512024-12-12T22:34:26.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7522024-12-12T22:34:26.334ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7532024-12-12T22:34:26.336ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7542024-12-12T22:34:26.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7552024-12-12T22:34:26.337ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7562024-12-12T22:34:26.338ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7572024-12-12T22:34:26.339ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7582024-12-12T22:34:26.339ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7592024-12-12T22:34:26.342ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7602024-12-12T22:34:26.345ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7612024-12-12T22:34:26.345ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7622024-12-12T22:34:26.346ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7632024-12-12T22:34:26.347ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7642024-12-12T22:34:26.347ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
7652024-12-12T22:34:26.347ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 241.884321ms iteration = 1 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
7662024-12-12T22:34:26.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7672024-12-12T22:34:26.349ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7682024-12-12T22:34:26.349ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7692024-12-12T22:34:26.350ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7702024-12-12T22:34:26.354ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
7712024-12-12T22:34:26.354ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7722024-12-12T22:34:26.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7732024-12-12T22:34:26.357ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7742024-12-12T22:34:26.357ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7752024-12-12T22:34:26.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7762024-12-12T22:34:26.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7772024-12-12T22:34:26.360ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7782024-12-12T22:34:26.360ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
7792024-12-12T22:34:26.361ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7802024-12-12T22:34:26.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7812024-12-12T22:34:26.362ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7822024-12-12T22:34:26.362ZDEBGnexus (dropshot_internal): updating rack subnet for rack ceaea472-35b2-490f-a91b-ab350691945c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7832024-12-12T22:34:26.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7842024-12-12T22:34:26.362ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
7852024-12-12T22:34:26.362ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7862024-12-12T22:34:26.364ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
7872024-12-12T22:34:26.364ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
7882024-12-12T22:34:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
7892024-12-12T22:34:26.369ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
7902024-12-12T22:34:26.372ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
7912024-12-12T22:34:26.372ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = []
7922024-12-12T22:34:26.372ZDEBGnexus (service-firewall-rule-progator): resolved 0 rules for sleds background_task = service_firewall_rule_propagation
7932024-12-12T22:34:26.382ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(2d473607-e2da-4f1a-9125-72bfbaf56798, 0), (9c4d70a8-4fca-43c1-8792-d5cca7b33de0, 0)]
7942024-12-12T22:34:26.382ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
7952024-12-12T22:34:26.382ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3397, tv_nsec: 304459868 } })
7962024-12-12T22:34:26.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
7972024-12-12T22:34:26.389ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
7982024-12-12T22:34:26.389ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
7992024-12-12T22:34:26.391ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8002024-12-12T22:34:26.393ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8012024-12-12T22:34:26.393ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8022024-12-12T22:34:26.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8032024-12-12T22:34:26.418ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8042024-12-12T22:34:26.420ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8052024-12-12T22:34:26.420ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "421a2675-e16c-4d9e-8bc1-0ec4cc9a867b", "content-length": "24", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} }) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8062024-12-12T22:34:26.423ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
8072024-12-12T22:34:26.423ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
8082024-12-12T22:34:26.423ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8092024-12-12T22:34:26.423ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8102024-12-12T22:34:26.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8112024-12-12T22:34:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
8122024-12-12T22:34:26.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8132024-12-12T22:34:26.436ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
8142024-12-12T22:34:26.436ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
8152024-12-12T22:34:26.436ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
8162024-12-12T22:34:26.437ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "ce3cedbb-ffb3-417f-8b04-50bf39a9fbb8", "content-length": "476", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8172024-12-12T22:34:26.438ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
8182024-12-12T22:34:26.438ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0069c59d-a263-44b4-9bed-aa6917cef9ec", "content-length": "734", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8192024-12-12T22:34:26.439ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
8202024-12-12T22:34:26.439ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8212024-12-12T22:34:26.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8222024-12-12T22:34:26.439ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6e52cec4-816b-463b-aca7-b41eeec345df", "content-length": "111", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8232024-12-12T22:34:26.440ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8242024-12-12T22:34:26.440ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
8252024-12-12T22:34:26.441ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "e0af7549-3bdb-48f3-9170-61e7bfd78f90", "content-length": "111", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8262024-12-12T22:34:26.441ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
8272024-12-12T22:34:26.441ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "afda389e-5dfd-407c-88c5-a0890e8b0d6c", "content-length": "167", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8282024-12-12T22:34:26.441ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
8292024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9424430f-65f5-4500-90b3-4d2945910bcd", "content-length": "167", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8302024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
8312024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3eefbb97-8a62-4929-8cfc-6571a17753bd", "content-length": "175", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8322024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
8332024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9b45b23-93f9-4985-b05e-8c5a5c59b8e6", "content-length": "175", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8342024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
8352024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f4c3fad7-5463-4042-8e0a-01cd04b1fefb", "content-length": "702", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8362024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8372024-12-12T22:34:26.442ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "68d655f4-afd4-424f-8a75-ab5ba4d30e39", "content-length": "727", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8382024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8392024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "a721867d-f774-4a67-abd6-ee8a7e5f13bf", "content-length": "729", "date": "Thu, 12 Dec 2024 22:34:26 GMT"} })
8402024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
8412024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f71dc7d-703e-4aaf-9e0e-4fca4f8b83f9", "content-length": "728", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8422024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
8432024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0ed4ce80-1665-4e6c-a53b-d23bb4d03348", "content-length": "722", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8442024-12-12T22:34:26.443ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
8452024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "3461a3c2-1ec2-4e48-8b78-af0bf028d4a5", "content-length": "109", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8462024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
8472024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "9118ffff-1976-438e-863b-3c03acd6f087", "content-length": "109", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8482024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
8492024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ade1f7ba-9d72-49c4-b781-732945317fe1", "content-length": "169", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8502024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
8512024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "489cc50d-5d74-4d3a-b437-bc64b47b1fb1", "content-length": "169", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8522024-12-12T22:34:26.444ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
8532024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "46ba00c8-8a5b-4dd4-9db1-b8b91a906c0c", "content-length": "178", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8542024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
8552024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "37977a87-ac87-4ed8-8de8-3690dbf2bd0e", "content-length": "178", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8562024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
8572024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e51b4e61-03a5-4957-b1ee-eeab51fdfab9", "content-length": "702", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8582024-12-12T22:34:26.445ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8592024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a1ebd21-1582-4151-97cb-cb11034f3f2b", "content-length": "727", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8602024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8612024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7416c14-e69f-4c77-8585-95b36630c434", "content-length": "729", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8622024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
8632024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "877b0fff-2d92-4d0e-bf41-64c5d8289947", "content-length": "728", "date": "Thu, 12 Dec 2024 22:34:25 GMT"} })
8642024-12-12T22:34:26.446ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8652024-12-12T22:34:26.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8662024-12-12T22:34:26.448ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8672024-12-12T22:34:26.451ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8682024-12-12T22:34:26.451ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8692024-12-12T22:34:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8702024-12-12T22:34:26.453ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8712024-12-12T22:34:26.455ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
8722024-12-12T22:34:26.455ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8732024-12-12T22:34:26.455ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8742024-12-12T22:34:26.464ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
8752024-12-12T22:34:26.464ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
8762024-12-12T22:34:26.464ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
8772024-12-12T22:34:26.466ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8782024-12-12T22:34:26.466ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8792024-12-12T22:34:26.468ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
8802024-12-12T22:34:26.470ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
8812024-12-12T22:34:26.470ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
8822024-12-12T22:34:26.470ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
8832024-12-12T22:34:26.489ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 383.626605ms iteration = 1 status = {}
8842024-12-12T22:34:26.504ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8852024-12-12T22:34:26.504ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
8862024-12-12T22:34:26.529ZERROnexus (BackgroundTasks): nexus is running but no service zone nat values could be generated from inventory background_task = service_zone_nat_tracker file = nexus/src/app/background/tasks/sync_service_zone_nat.rs:257
8872024-12-12T22:34:26.529ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 424.353564ms iteration = 1 status = {"error":"nexus is running but no service zone nat values could be generated from inventory"}
8882024-12-12T22:34:26.548ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = []
8892024-12-12T22:34:26.548ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
8902024-12-12T22:34:26.548ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 0 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
8912024-12-12T22:34:26.549ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 442.875658ms
8922024-12-12T22:34:26.549ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 442.895018ms iteration = 1 status = {}
8932024-12-12T22:34:26.564ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 2ce21300-7dcf-418c-a128-85db2b099fe9 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
8942024-12-12T22:34:26.564ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 2ce21300-7dcf-418c-a128-85db2b099fe9 time_started = 2024-12-12 22:34:26.435773 UTC
8952024-12-12T22:34:26.564ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 459.502305ms iteration = 1 status = {"collection_id":"2ce21300-7dcf-418c-a128-85db2b099fe9","time_done":"2024-12-12 22:34:26.464886 UTC","time_started":"2024-12-12 22:34:26.435773 UTC"}
8962024-12-12T22:34:26.564ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 2 reason = Dependency
8972024-12-12T22:34:26.564ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
8982024-12-12T22:34:26.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
8992024-12-12T22:34:26.566ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9002024-12-12T22:34:26.568ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
9012024-12-12T22:34:26.568ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
9022024-12-12T22:34:26.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
9032024-12-12T22:34:26.570ZINFOnexus (BackgroundTasks): Physical Disk Adoption: Rack not yet initialized background_task = physical_disk_adoption file = nexus/src/app/background/tasks/physical_disk_adoption.rs:80 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
9042024-12-12T22:34:26.570ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 5.967037ms iteration = 2 status = {"error":"rack not yet initialized: ceaea472-35b2-490f-a91b-ab350691945c"}
9052024-12-12T22:34:26.654ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9062024-12-12T22:34:26.654ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9072024-12-12T22:34:26.662ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9082024-12-12T22:34:26.662ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9092024-12-12T22:34:26.670ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9102024-12-12T22:34:26.670ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9112024-12-12T22:34:26.690ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9122024-12-12T22:34:26.703ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9132024-12-12T22:34:26.704ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9142024-12-12T22:34:26.705ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9152024-12-12T22:34:26.706ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9162024-12-12T22:34:26.706ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9172024-12-12T22:34:26.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9182024-12-12T22:34:26.709ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9192024-12-12T22:34:26.709ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9202024-12-12T22:34:26.711ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9212024-12-12T22:34:26.713ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9222024-12-12T22:34:26.713ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9232024-12-12T22:34:26.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9242024-12-12T22:34:26.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9252024-12-12T22:34:26.715ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9262024-12-12T22:34:26.716ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9272024-12-12T22:34:26.718ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9282024-12-12T22:34:26.748ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9292024-12-12T22:34:26.749ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9302024-12-12T22:34:26.750ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9312024-12-12T22:34:26.752ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9322024-12-12T22:34:26.889ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 9340586b-e531-4e39-8dbf-b547c38f365c file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9332024-12-12T22:34:26.889ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9342024-12-12T22:34:26.889ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9352024-12-12T22:34:26.891ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9362024-12-12T22:34:26.892ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9372024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9382024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9392024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9402024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9412024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9422024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9432024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9442024-12-12T22:34:26.898ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9452024-12-12T22:34:27.019ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9462024-12-12T22:34:27.035ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9472024-12-12T22:34:27.054ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9482024-12-12T22:34:27.076ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9492024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9502024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9512024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9522024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9532024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9542024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9552024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9562024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9572024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9582024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9592024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9602024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9612024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9622024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9632024-12-12T22:34:27.090ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9642024-12-12T22:34:27.111ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9652024-12-12T22:34:27.111ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9662024-12-12T22:34:27.111ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), time_created: 2024-12-12T22:34:26.334324173Z, time_modified: 2024-12-12T22:34:26.334324173Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9672024-12-12T22:34:27.111ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9682024-12-12T22:34:27.111ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9692024-12-12T22:34:27.113ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9702024-12-12T22:34:27.114ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9712024-12-12T22:34:27.133ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(4a8c9490-d35a-4221-8585-e4103b325118)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9722024-12-12T22:34:27.137ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" error_message_internal = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 807191 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 546b293d-458e-41e9-bf9c-2c3b6f2c4c22 response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9732024-12-12T22:34:27.309ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9742024-12-12T22:34:27.309ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9752024-12-12T22:34:27.310ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
9762024-12-12T22:34:27.310ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
9772024-12-12T22:34:27.312ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
9782024-12-12T22:34:27.315ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
9792024-12-12T22:34:27.315ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
9802024-12-12T22:34:29.053ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9812024-12-12T22:34:29.054ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9822024-12-12T22:34:29.056ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9832024-12-12T22:34:29.057ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9842024-12-12T22:34:29.057ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9852024-12-12T22:34:29.057ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9862024-12-12T22:34:29.064ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9872024-12-12T22:34:29.065ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9882024-12-12T22:34:29.066ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9892024-12-12T22:34:29.067ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9902024-12-12T22:34:29.068ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9912024-12-12T22:34:29.071ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9922024-12-12T22:34:29.071ZDEBGnexus (dropshot_internal): updating rack subnet for rack ceaea472-35b2-490f-a91b-ab350691945c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9932024-12-12T22:34:29.071ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9942024-12-12T22:34:29.071ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9952024-12-12T22:34:29.077ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9962024-12-12T22:34:29.109ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9972024-12-12T22:34:29.109ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "28468a4c-499e-4208-be88-925b092fdd2a", "content-length": "24", "date": "Thu, 12 Dec 2024 22:34:28 GMT"} }) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9982024-12-12T22:34:29.109ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
9992024-12-12T22:34:29.109ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10002024-12-12T22:34:29.109ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10012024-12-12T22:34:29.110ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10022024-12-12T22:34:29.122ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10032024-12-12T22:34:29.122ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10042024-12-12T22:34:29.123ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10052024-12-12T22:34:29.140ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10062024-12-12T22:34:29.140ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10072024-12-12T22:34:29.144ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10082024-12-12T22:34:29.144ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10092024-12-12T22:34:29.153ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10102024-12-12T22:34:29.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10112024-12-12T22:34:29.156ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10122024-12-12T22:34:29.156ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10132024-12-12T22:34:29.171ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10142024-12-12T22:34:29.173ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10152024-12-12T22:34:29.173ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10162024-12-12T22:34:29.174ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10172024-12-12T22:34:29.176ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10182024-12-12T22:34:29.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10192024-12-12T22:34:29.176ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10202024-12-12T22:34:29.186ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10212024-12-12T22:34:29.186ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10222024-12-12T22:34:29.188ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10232024-12-12T22:34:29.190ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10242024-12-12T22:34:29.190ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10252024-12-12T22:34:29.190ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10262024-12-12T22:34:29.192ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10272024-12-12T22:34:29.192ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10282024-12-12T22:34:29.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10292024-12-12T22:34:29.195ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10302024-12-12T22:34:29.218ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10312024-12-12T22:34:29.219ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10322024-12-12T22:34:29.220ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10332024-12-12T22:34:29.222ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10342024-12-12T22:34:29.315ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10352024-12-12T22:34:29.316ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10362024-12-12T22:34:29.317ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10372024-12-12T22:34:29.318ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10382024-12-12T22:34:29.319ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10392024-12-12T22:34:29.321ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
10402024-12-12T22:34:29.321ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10412024-12-12T22:34:29.374ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 9340586b-e531-4e39-8dbf-b547c38f365c file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10422024-12-12T22:34:29.374ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10432024-12-12T22:34:29.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10442024-12-12T22:34:29.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10452024-12-12T22:34:29.378ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10462024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10472024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10482024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10492024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10502024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10512024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10522024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10532024-12-12T22:34:29.390ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10542024-12-12T22:34:29.512ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10552024-12-12T22:34:29.541ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10562024-12-12T22:34:29.563ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10572024-12-12T22:34:29.587ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10582024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10592024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10602024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10612024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10622024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10632024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10642024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10652024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10662024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10672024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10682024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10692024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10702024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10712024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10722024-12-12T22:34:29.607ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10732024-12-12T22:34:29.630ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10742024-12-12T22:34:29.630ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10752024-12-12T22:34:29.630ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), time_created: 2024-12-12T22:34:29.057276731Z, time_modified: 2024-12-12T22:34:29.057276731Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10762024-12-12T22:34:29.630ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10772024-12-12T22:34:29.631ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10782024-12-12T22:34:29.632ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10792024-12-12T22:34:29.634ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10802024-12-12T22:34:29.654ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(4a8c9490-d35a-4221-8585-e4103b325118)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10812024-12-12T22:34:29.664ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" error_message_internal = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 610999 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 8e418392-3abf-48ce-a18e-6e70c2c81370 response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10822024-12-12T22:34:31.323ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10832024-12-12T22:34:31.323ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10842024-12-12T22:34:31.325ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
10852024-12-12T22:34:31.325ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
10862024-12-12T22:34:31.327ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
10872024-12-12T22:34:31.329ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
10882024-12-12T22:34:31.329ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
10892024-12-12T22:34:31.872ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10902024-12-12T22:34:31.872ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10912024-12-12T22:34:31.874ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10922024-12-12T22:34:31.875ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10932024-12-12T22:34:31.875ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10942024-12-12T22:34:31.875ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10952024-12-12T22:34:31.890ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10962024-12-12T22:34:31.890ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10972024-12-12T22:34:31.892ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10982024-12-12T22:34:31.892ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
10992024-12-12T22:34:31.894ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11002024-12-12T22:34:31.896ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11012024-12-12T22:34:31.896ZDEBGnexus (dropshot_internal): updating rack subnet for rack ceaea472-35b2-490f-a91b-ab350691945c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11022024-12-12T22:34:31.896ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11032024-12-12T22:34:31.896ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11042024-12-12T22:34:31.910ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11052024-12-12T22:34:31.942ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11062024-12-12T22:34:31.942ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "b235121d-09dd-4c3e-b43f-6230bc072e8a", "content-length": "24", "date": "Thu, 12 Dec 2024 22:34:31 GMT"} }) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11072024-12-12T22:34:31.942ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11082024-12-12T22:34:31.942ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11092024-12-12T22:34:31.942ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11102024-12-12T22:34:31.942ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11112024-12-12T22:34:31.954ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11122024-12-12T22:34:31.954ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11132024-12-12T22:34:31.954ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11142024-12-12T22:34:31.958ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11152024-12-12T22:34:31.959ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11162024-12-12T22:34:31.968ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11172024-12-12T22:34:31.968ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11182024-12-12T22:34:31.975ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11192024-12-12T22:34:31.975ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11202024-12-12T22:34:31.977ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11212024-12-12T22:34:31.977ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11222024-12-12T22:34:31.991ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11232024-12-12T22:34:31.992ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11242024-12-12T22:34:31.992ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11252024-12-12T22:34:31.994ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11262024-12-12T22:34:31.995ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11272024-12-12T22:34:31.995ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11282024-12-12T22:34:31.995ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11292024-12-12T22:34:32.002ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11302024-12-12T22:34:32.002ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11312024-12-12T22:34:32.004ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11322024-12-12T22:34:32.007ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11332024-12-12T22:34:32.007ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11342024-12-12T22:34:32.008ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11352024-12-12T22:34:32.009ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11362024-12-12T22:34:32.009ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11372024-12-12T22:34:32.018ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11382024-12-12T22:34:32.020ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11392024-12-12T22:34:32.036ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11402024-12-12T22:34:32.036ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11412024-12-12T22:34:32.037ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11422024-12-12T22:34:32.039ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11432024-12-12T22:34:32.178ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 9340586b-e531-4e39-8dbf-b547c38f365c file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11442024-12-12T22:34:32.178ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11452024-12-12T22:34:32.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11462024-12-12T22:34:32.181ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11472024-12-12T22:34:32.181ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:34794
11482024-12-12T22:34:32.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 08890dcf-7fa4-4968-bdc7-839aa7fb8bbd roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
11492024-12-12T22:34:32.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 08890dcf-7fa4-4968-bdc7-839aa7fb8bbd resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
11502024-12-12T22:34:32.182ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11512024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11522024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11532024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11542024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11552024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11562024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11572024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11582024-12-12T22:34:32.189ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11592024-12-12T22:34:32.191ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 9285 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 08890dcf-7fa4-4968-bdc7-839aa7fb8bbd response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
11602024-12-12T22:34:32.311ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11612024-12-12T22:34:32.335ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11622024-12-12T22:34:32.365ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11632024-12-12T22:34:32.392ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11642024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11652024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11662024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11672024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11682024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11692024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11702024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11712024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11722024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11732024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11742024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11752024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11762024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11772024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11782024-12-12T22:34:32.413ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11792024-12-12T22:34:32.434ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11802024-12-12T22:34:32.434ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11812024-12-12T22:34:32.434ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), time_created: 2024-12-12T22:34:31.875697183Z, time_modified: 2024-12-12T22:34:31.875697183Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11822024-12-12T22:34:32.434ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11832024-12-12T22:34:32.434ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11842024-12-12T22:34:32.436ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11852024-12-12T22:34:32.437ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11862024-12-12T22:34:32.468ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(4a8c9490-d35a-4221-8585-e4103b325118)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11872024-12-12T22:34:32.474ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" error_message_internal = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 602570 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 0ceaece1-bf2a-4a63-8418-ffc76a2edfc8 response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
11882024-12-12T22:34:33.330ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11892024-12-12T22:34:33.330ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11902024-12-12T22:34:33.332ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
11912024-12-12T22:34:33.332ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
11922024-12-12T22:34:33.333ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
11932024-12-12T22:34:33.336ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
11942024-12-12T22:34:33.336ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
11952024-12-12T22:34:33.352ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:49323
11962024-12-12T22:34:33.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49323 req_id = 20ea268d-3c6d-411f-a50f-47f3f90d0460 roles = RoleSet { roles: {} } uri = /metrics/producers
11972024-12-12T22:34:33.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49323 req_id = 20ea268d-3c6d-411f-a50f-47f3f90d0460 resource = Database result = Ok(()) uri = /metrics/producers
11982024-12-12T22:34:33.372ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = bb9dca28-dea1-4105-b015-9af4a5ccce7e
11992024-12-12T22:34:33.372ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 14145 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:49323 req_id = 20ea268d-3c6d-411f-a50f-47f3f90d0460 response_code = 201 uri = /metrics/producers
12002024-12-12T22:34:34.664ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12012024-12-12T22:34:34.665ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12022024-12-12T22:34:34.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12032024-12-12T22:34:34.668ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12042024-12-12T22:34:34.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12052024-12-12T22:34:34.668ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12062024-12-12T22:34:34.694ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12072024-12-12T22:34:34.694ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12082024-12-12T22:34:34.695ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12092024-12-12T22:34:34.696ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12102024-12-12T22:34:34.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12112024-12-12T22:34:34.700ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12122024-12-12T22:34:34.700ZDEBGnexus (dropshot_internal): updating rack subnet for rack ceaea472-35b2-490f-a91b-ab350691945c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12132024-12-12T22:34:34.700ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12142024-12-12T22:34:34.700ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12152024-12-12T22:34:34.711ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12162024-12-12T22:34:34.741ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12172024-12-12T22:34:34.742ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc0ce5cc-c58d-43e7-ab0b-165b731ba2ce", "content-length": "24", "date": "Thu, 12 Dec 2024 22:34:34 GMT"} }) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12182024-12-12T22:34:34.742ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12192024-12-12T22:34:34.742ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12202024-12-12T22:34:34.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12212024-12-12T22:34:34.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12222024-12-12T22:34:34.762ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12232024-12-12T22:34:34.762ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12242024-12-12T22:34:34.762ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12252024-12-12T22:34:34.784ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12262024-12-12T22:34:34.785ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12272024-12-12T22:34:34.787ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12282024-12-12T22:34:34.787ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12292024-12-12T22:34:34.789ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12302024-12-12T22:34:34.790ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12312024-12-12T22:34:34.791ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12322024-12-12T22:34:34.792ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12332024-12-12T22:34:34.811ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12342024-12-12T22:34:34.813ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12352024-12-12T22:34:34.813ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12362024-12-12T22:34:34.814ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12372024-12-12T22:34:34.816ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12382024-12-12T22:34:34.816ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12392024-12-12T22:34:34.816ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12402024-12-12T22:34:34.818ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12412024-12-12T22:34:34.818ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12422024-12-12T22:34:34.819ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12432024-12-12T22:34:34.822ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12442024-12-12T22:34:34.822ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12452024-12-12T22:34:34.822ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12462024-12-12T22:34:34.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12472024-12-12T22:34:34.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12482024-12-12T22:34:34.825ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12492024-12-12T22:34:34.827ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12502024-12-12T22:34:34.846ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12512024-12-12T22:34:34.846ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12522024-12-12T22:34:34.847ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12532024-12-12T22:34:34.849ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12542024-12-12T22:34:35.013ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 9340586b-e531-4e39-8dbf-b547c38f365c file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12552024-12-12T22:34:35.013ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12562024-12-12T22:34:35.014ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12572024-12-12T22:34:35.015ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12582024-12-12T22:34:35.017ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12592024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12602024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12612024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12622024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12632024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12642024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12652024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12662024-12-12T22:34:35.030ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12672024-12-12T22:34:35.121ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12682024-12-12T22:34:35.152ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12692024-12-12T22:34:35.180ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12702024-12-12T22:34:35.205ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12712024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12722024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12732024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12742024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12752024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12762024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12772024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12782024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12792024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12802024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12812024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12822024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12832024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12842024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12852024-12-12T22:34:35.236ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12862024-12-12T22:34:35.256ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12872024-12-12T22:34:35.256ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12882024-12-12T22:34:35.256ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), time_created: 2024-12-12T22:34:34.668514603Z, time_modified: 2024-12-12T22:34:34.668514603Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12892024-12-12T22:34:35.256ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12902024-12-12T22:34:35.257ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12912024-12-12T22:34:35.258ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12922024-12-12T22:34:35.260ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12932024-12-12T22:34:35.276ZERROnexus (dropshot_internal): Failed to upsert physical disk actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true err = Custom transaction error: Object (of type ById(4a8c9490-d35a-4221-8585-e4103b325118)) not found: sled file = nexus/db-queries/src/db/datastore/rack.rs:816 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12942024-12-12T22:34:35.280ZINFOnexus (dropshot_internal): request completed error_message_external = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" error_message_internal = not found: sled with id "4a8c9490-d35a-4221-8585-e4103b325118" file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:851 latency_us = 616883 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = e5afc778-c858-455b-be1e-a4fe7a51a7ba response_code = 404 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
12952024-12-12T22:34:35.336ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12962024-12-12T22:34:35.337ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12972024-12-12T22:34:35.338ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
12982024-12-12T22:34:35.338ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
12992024-12-12T22:34:35.340ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13002024-12-12T22:34:35.342ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
13012024-12-12T22:34:35.342ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13022024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 2 reason = Timeout
13032024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 2 reason = Timeout
13042024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13052024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13062024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13072024-12-12T22:34:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13082024-12-12T22:34:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13092024-12-12T22:34:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
13102024-12-12T22:34:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
13112024-12-12T22:34:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
13122024-12-12T22:34:36.112ZWARNnexus (BackgroundTasks): failed to read target blueprint background_task = blueprint_loader error = Internal Error: no target blueprint set file = nexus/src/app/background/tasks/blueprint_load.rs:69
13132024-12-12T22:34:36.112ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 7.15056ms iteration = 2 status = {"error":"failed to read target blueprint: Internal Error: no target blueprint set"}
13142024-12-12T22:34:36.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
13152024-12-12T22:34:36.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
13162024-12-12T22:34:36.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.139832ms iteration = 2 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
13172024-12-12T22:34:37.339ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13182024-12-12T22:34:37.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13192024-12-12T22:34:37.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13202024-12-12T22:34:37.342ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13212024-12-12T22:34:37.342ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13222024-12-12T22:34:37.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13232024-12-12T22:34:37.344ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13242024-12-12T22:34:37.344ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13252024-12-12T22:34:37.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13262024-12-12T22:34:37.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13272024-12-12T22:34:37.345ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
13282024-12-12T22:34:37.345ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
13292024-12-12T22:34:37.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13302024-12-12T22:34:37.347ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13312024-12-12T22:34:37.347ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
13322024-12-12T22:34:37.349ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13332024-12-12T22:34:37.350ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
13342024-12-12T22:34:37.350ZINFOnexus: Still waiting for rack initialization: Rack { identity: RackIdentity { id: ceaea472-35b2-490f-a91b-ab350691945c, time_created: 2024-12-12T22:34:25.940359Z, time_modified: 2024-12-12T22:34:25.940359Z }, initialized: false, tuf_base_url: None, rack_subnet: Some(V6(Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56 })) } file = nexus/src/app/rack.rs:768
13352024-12-12T22:34:37.352ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13362024-12-12T22:34:37.352ZDEBGnexus (dropshot_internal): updating rack subnet for rack ceaea472-35b2-490f-a91b-ab350691945c to Some( V6( Ipv6Network { addr: fd00:1122:3344:100::, prefix: 56, }, ), ) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13372024-12-12T22:34:37.352ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13382024-12-12T22:34:37.352ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13392024-12-12T22:34:37.358ZINFOnexus (dropshot_internal): Using automatic external switchport discovery actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:324 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13402024-12-12T22:34:37.390ZDEBGnexus (DpdClient): client request actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true body = None local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13412024-12-12T22:34:37.390ZDEBGnexus (DpdClient): client response actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/ports", status: 200, headers: {"content-type": "application/json", "x-request-id": "e5a809da-52d7-4fe1-b118-fd2fbcc64408", "content-length": "24", "date": "Thu, 12 Dec 2024 22:34:36 GMT"} }) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13422024-12-12T22:34:37.390ZINFOnexus (dropshot_internal): discovered ports for switch0: [ Internal( Internal( "int0", ), ), Rear( Rear( "rear0", ), ), Qsfp( Qsfp( "qsfp0", ), ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:344 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13432024-12-12T22:34:37.390ZINFOnexus (dropshot_internal): populating ports for switch0: [ Name( "qsfp0", ), ] actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:354 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13442024-12-12T22:34:37.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13452024-12-12T22:34:37.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13462024-12-12T22:34:37.403ZINFOnexus (dropshot_internal): Recording Rack Network Configuration actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/src/app/rack.rs:389 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13472024-12-12T22:34:37.403ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13482024-12-12T22:34:37.403ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13492024-12-12T22:34:37.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13502024-12-12T22:34:37.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13512024-12-12T22:34:37.410ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13522024-12-12T22:34:37.410ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13532024-12-12T22:34:37.412ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13542024-12-12T22:34:37.412ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13552024-12-12T22:34:37.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13562024-12-12T22:34:37.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13572024-12-12T22:34:37.416ZDEBGnexus (dropshot_internal): failed to check if bgp peer exists in switch port settings actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true error = NotFound local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13582024-12-12T22:34:37.417ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13592024-12-12T22:34:37.417ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13602024-12-12T22:34:37.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13612024-12-12T22:34:37.420ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13622024-12-12T22:34:37.420ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13632024-12-12T22:34:37.420ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13642024-12-12T22:34:37.422ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13652024-12-12T22:34:37.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13662024-12-12T22:34:37.425ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13672024-12-12T22:34:37.427ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13682024-12-12T22:34:37.427ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13692024-12-12T22:34:37.427ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13702024-12-12T22:34:37.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13712024-12-12T22:34:37.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13722024-12-12T22:34:37.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13732024-12-12T22:34:37.432ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = IpPool { parent: Fleet, key: 4b8f66e7-38a8-4b4b-84d4-83eaaa7ac740, lookup_type: ByName("oxide-service-pool") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13742024-12-12T22:34:37.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13752024-12-12T22:34:37.439ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13762024-12-12T22:34:37.440ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13772024-12-12T22:34:37.442ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13782024-12-12T22:34:37.459ZINFOnexus (dropshot_internal): inserted blueprint actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true blueprint_id = 9340586b-e531-4e39-8dbf-b547c38f365c file = nexus/db-queries/src/db/datastore/deployment.rs:456 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13792024-12-12T22:34:37.459ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13802024-12-12T22:34:37.459ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13812024-12-12T22:34:37.460ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13822024-12-12T22:34:37.462ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = BlueprintConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13832024-12-12T22:34:37.466ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13842024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13852024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for internal_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13862024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13872024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13882024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13892024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13902024-12-12T22:34:37.467ZINFOnexus (dropshot_internal): No networking records needed for cockroach_db service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13912024-12-12T22:34:37.488ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13922024-12-12T22:34:37.509ZINFOnexus (dropshot_internal): Inserted networking records for external_dns service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13932024-12-12T22:34:37.542ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13942024-12-12T22:34:37.567ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13952024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): Inserted networking records for nexus service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13962024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for oximeter service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13972024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for clickhouse service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13982024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
13992024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14002024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible_pantry service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14012024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14022024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14032024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14042024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14052024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14062024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14072024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14082024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14092024-12-12T22:34:37.589ZINFOnexus (dropshot_internal): No networking records needed for crucible service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:606 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14102024-12-12T22:34:37.611ZINFOnexus (dropshot_internal): Inserted networking records for boundary_ntp service actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:650 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14112024-12-12T22:34:37.611ZINFOnexus (dropshot_internal): Inserted service networking records actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:809 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14122024-12-12T22:34:37.611ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f44b2a4b-13a1-45a1-a4b6-62b638300768 (physical_disk), time_created: 2024-12-12T22:34:37.342763154Z, time_modified: 2024-12-12T22:34:37.342763154Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-0", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14132024-12-12T22:34:37.611ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14142024-12-12T22:34:37.611ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14152024-12-12T22:34:37.613ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14162024-12-12T22:34:37.615ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14172024-12-12T22:34:37.621ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 43fe7431-9be0-4b0a-92a3-defd7a65d29a (physical_disk), time_created: 2024-12-12T22:34:37.342763594Z, time_modified: 2024-12-12T22:34:37.342763594Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-1", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14182024-12-12T22:34:37.621ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14192024-12-12T22:34:37.621ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14202024-12-12T22:34:37.623ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14212024-12-12T22:34:37.625ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14222024-12-12T22:34:37.633ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: dd59a4cd-91af-4947-98c0-aeccbe77e648 (physical_disk), time_created: 2024-12-12T22:34:37.342763714Z, time_modified: 2024-12-12T22:34:37.342763714Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-2", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14232024-12-12T22:34:37.633ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14242024-12-12T22:34:37.633ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14252024-12-12T22:34:37.634ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14262024-12-12T22:34:37.636ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14272024-12-12T22:34:37.645ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: f39e81a4-26e2-4226-865f-7e76631cdb5d (physical_disk), time_created: 2024-12-12T22:34:37.342763814Z, time_modified: 2024-12-12T22:34:37.342763814Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-3", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14282024-12-12T22:34:37.645ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14292024-12-12T22:34:37.645ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14302024-12-12T22:34:37.647ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14312024-12-12T22:34:37.649ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14322024-12-12T22:34:37.653ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 82f10c8f-d962-4ca1-973d-e35f38a002a7 (physical_disk), time_created: 2024-12-12T22:34:37.342763894Z, time_modified: 2024-12-12T22:34:37.342763894Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-4", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14332024-12-12T22:34:37.653ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14342024-12-12T22:34:37.653ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14352024-12-12T22:34:37.655ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14362024-12-12T22:34:37.657ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14372024-12-12T22:34:37.665ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 7b00a1b5-80c5-42f3-8f94-bb13b3fa8625 (physical_disk), time_created: 2024-12-12T22:34:37.342763964Z, time_modified: 2024-12-12T22:34:37.342763964Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-5", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14382024-12-12T22:34:37.665ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14392024-12-12T22:34:37.666ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14402024-12-12T22:34:37.667ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14412024-12-12T22:34:37.669ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14422024-12-12T22:34:37.674ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: 3df77c9d-a509-4db6-961c-c78ffe40f6cf (physical_disk), time_created: 2024-12-12T22:34:37.342764044Z, time_modified: 2024-12-12T22:34:37.342764044Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-6", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14432024-12-12T22:34:37.674ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14442024-12-12T22:34:37.674ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14452024-12-12T22:34:37.676ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14462024-12-12T22:34:37.677ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14472024-12-12T22:34:37.681ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: b10b8eec-2683-4122-ba78-d2269cb86ec7 (physical_disk), time_created: 2024-12-12T22:34:37.342764124Z, time_modified: 2024-12-12T22:34:37.342764124Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-7", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14482024-12-12T22:34:37.681ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14492024-12-12T22:34:37.682ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14502024-12-12T22:34:37.683ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14512024-12-12T22:34:37.685ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14522024-12-12T22:34:37.689ZINFOnexus (dropshot_internal): physical disk upsert in handoff: PhysicalDisk { identity: PhysicalDiskIdentity { id: aebf9e4b-9c07-4533-9528-f713d49adea5 (physical_disk), time_created: 2024-12-12T22:34:37.342764194Z, time_modified: 2024-12-12T22:34:37.342764194Z, }, time_deleted: None, rcgen: Generation( Generation( 1, ), ), vendor: "synthetic-vendor", serial: "synthetic-serial-8", model: "synthetic-model-U2", variant: U2, sled_id: 4a8c9490-d35a-4221-8585-e4103b325118, disk_policy: InService, disk_state: Active, } actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:812 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14532024-12-12T22:34:37.689ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14542024-12-12T22:34:37.689ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14552024-12-12T22:34:37.691ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14562024-12-12T22:34:37.693ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14572024-12-12T22:34:37.697ZINFOnexus (dropshot_internal): Inserted physical disks actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:824 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14582024-12-12T22:34:37.697ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14592024-12-12T22:34:37.698ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14602024-12-12T22:34:37.699ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14612024-12-12T22:34:37.700ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14622024-12-12T22:34:37.707ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14632024-12-12T22:34:37.707ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14642024-12-12T22:34:37.708ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14652024-12-12T22:34:37.710ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14662024-12-12T22:34:37.714ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14672024-12-12T22:34:37.714ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14682024-12-12T22:34:37.715ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14692024-12-12T22:34:37.716ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14702024-12-12T22:34:37.721ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14712024-12-12T22:34:37.721ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14722024-12-12T22:34:37.722ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14732024-12-12T22:34:37.723ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14742024-12-12T22:34:37.728ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14752024-12-12T22:34:37.728ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14762024-12-12T22:34:37.729ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14772024-12-12T22:34:37.730ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14782024-12-12T22:34:37.735ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14792024-12-12T22:34:37.735ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14802024-12-12T22:34:37.736ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14812024-12-12T22:34:37.738ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14822024-12-12T22:34:37.742ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14832024-12-12T22:34:37.742ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14842024-12-12T22:34:37.744ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14852024-12-12T22:34:37.745ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14862024-12-12T22:34:37.749ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14872024-12-12T22:34:37.750ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14882024-12-12T22:34:37.751ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14892024-12-12T22:34:37.752ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14902024-12-12T22:34:37.756ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14912024-12-12T22:34:37.757ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14922024-12-12T22:34:37.758ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14932024-12-12T22:34:37.759ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14942024-12-12T22:34:37.763ZINFOnexus (dropshot_internal): Inserted zpools actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:836 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14952024-12-12T22:34:38.075ZINFOnexus (dropshot_internal): Inserted datasets actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:866 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14962024-12-12T22:34:38.098ZINFOnexus (dropshot_internal): Populated DNS tables for internal DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:877 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14972024-12-12T22:34:38.101ZINFOnexus (dropshot_internal): Populated DNS tables for external DNS actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:886 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14982024-12-12T22:34:38.101ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
14992024-12-12T22:34:38.101ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15002024-12-12T22:34:38.103ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15012024-12-12T22:34:38.104ZDEBGnexus (dropshot_internal): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15022024-12-12T22:34:38.104ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15032024-12-12T22:34:38.104ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15042024-12-12T22:34:38.106ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15052024-12-12T22:34:38.107ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15062024-12-12T22:34:38.163ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15072024-12-12T22:34:38.163ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15082024-12-12T22:34:38.165ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15092024-12-12T22:34:38.168ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = DnsConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15102024-12-12T22:34:38.168ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15112024-12-12T22:34:38.168ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15122024-12-12T22:34:38.170ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15132024-12-12T22:34:38.173ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = DnsConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15142024-12-12T22:34:38.175ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15152024-12-12T22:34:38.175ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15162024-12-12T22:34:38.176ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15172024-12-12T22:34:38.179ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = DnsConfig result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15182024-12-12T22:34:38.222ZINFOnexus (dropshot_internal): Created recovery silo actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:451 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15192024-12-12T22:34:38.238ZINFOnexus (dropshot_internal): Created recovery user actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:467 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15202024-12-12T22:34:38.270ZINFOnexus (dropshot_internal): Created recovery user's password actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:481 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15212024-12-12T22:34:38.270ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15222024-12-12T22:34:38.270ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15232024-12-12T22:34:38.274ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15242024-12-12T22:34:38.274ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15252024-12-12T22:34:38.276ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15262024-12-12T22:34:38.277ZDEBGnexus (dropshot_internal): authorize result action = ModifyPolicy actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15272024-12-12T22:34:38.277ZDEBGnexus (dropshot_internal): Generated role assignment queries actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15282024-12-12T22:34:38.282ZINFOnexus (dropshot_internal): Granted Silo privileges actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true file = nexus/db-queries/src/db/datastore/rack.rs:509 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15292024-12-12T22:34:38.282ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15302024-12-12T22:34:38.282ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15312024-12-12T22:34:38.284ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15322024-12-12T22:34:38.286ZDEBGnexus (dropshot_internal): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15332024-12-12T22:34:38.322ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15342024-12-12T22:34:38.322ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15352024-12-12T22:34:38.324ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15362024-12-12T22:34:38.324ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15372024-12-12T22:34:38.327ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15382024-12-12T22:34:38.327ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15392024-12-12T22:34:38.329ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15402024-12-12T22:34:38.329ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15412024-12-12T22:34:38.331ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15422024-12-12T22:34:38.331ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15432024-12-12T22:34:38.332ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15442024-12-12T22:34:38.333ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15452024-12-12T22:34:38.334ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15462024-12-12T22:34:38.337ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15472024-12-12T22:34:38.337ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15482024-12-12T22:34:38.338ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15492024-12-12T22:34:38.341ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15502024-12-12T22:34:38.342ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15512024-12-12T22:34:38.345ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15522024-12-12T22:34:38.345ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15532024-12-12T22:34:38.347ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15542024-12-12T22:34:38.350ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15552024-12-12T22:34:38.350ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15562024-12-12T22:34:38.350ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15572024-12-12T22:34:38.354ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15582024-12-12T22:34:38.354ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15592024-12-12T22:34:38.356ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15602024-12-12T22:34:38.356ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15612024-12-12T22:34:38.358ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15622024-12-12T22:34:38.358ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15632024-12-12T22:34:38.359ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15642024-12-12T22:34:38.359ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15652024-12-12T22:34:38.361ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15662024-12-12T22:34:38.361ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15672024-12-12T22:34:38.362ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15682024-12-12T22:34:38.363ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15692024-12-12T22:34:38.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15702024-12-12T22:34:38.367ZDEBGnexus (dropshot_internal): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15712024-12-12T22:34:38.367ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15722024-12-12T22:34:38.367ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15732024-12-12T22:34:38.369ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15742024-12-12T22:34:38.369ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15752024-12-12T22:34:38.370ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15762024-12-12T22:34:38.370ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15772024-12-12T22:34:38.372ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15782024-12-12T22:34:38.373ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15792024-12-12T22:34:38.375ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15802024-12-12T22:34:38.375ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15812024-12-12T22:34:38.376ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15822024-12-12T22:34:38.376ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15832024-12-12T22:34:38.377ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15842024-12-12T22:34:38.378ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15852024-12-12T22:34:38.379ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15862024-12-12T22:34:38.383ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15872024-12-12T22:34:38.383ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15882024-12-12T22:34:38.383ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15892024-12-12T22:34:38.390ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15902024-12-12T22:34:38.390ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15912024-12-12T22:34:38.391ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15922024-12-12T22:34:38.391ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15932024-12-12T22:34:38.393ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15942024-12-12T22:34:38.398ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15952024-12-12T22:34:38.398ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15962024-12-12T22:34:38.398ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15972024-12-12T22:34:38.402ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15982024-12-12T22:34:38.402ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
15992024-12-12T22:34:38.406ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16002024-12-12T22:34:38.407ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16012024-12-12T22:34:38.408ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16022024-12-12T22:34:38.408ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16032024-12-12T22:34:38.411ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16042024-12-12T22:34:38.411ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16052024-12-12T22:34:38.413ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16062024-12-12T22:34:38.413ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16072024-12-12T22:34:38.414ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16082024-12-12T22:34:38.415ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16092024-12-12T22:34:38.416ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16102024-12-12T22:34:38.416ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16112024-12-12T22:34:38.418ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16122024-12-12T22:34:38.421ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16132024-12-12T22:34:38.421ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16142024-12-12T22:34:38.422ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16152024-12-12T22:34:38.423ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16162024-12-12T22:34:38.423ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16172024-12-12T22:34:38.424ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16182024-12-12T22:34:38.425ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16192024-12-12T22:34:38.426ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16202024-12-12T22:34:38.430ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16212024-12-12T22:34:38.430ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16222024-12-12T22:34:38.431ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16232024-12-12T22:34:38.438ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("external-dns"): [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("nexus"): [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })], Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })]} vpc_interfaces = {}
16242024-12-12T22:34:38.438ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16252024-12-12T22:34:38.438ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16262024-12-12T22:34:38.439ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16272024-12-12T22:34:38.441ZDEBGnexus (dropshot_internal): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Fleet result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16282024-12-12T22:34:38.441ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 roles = RoleSet { roles: {} } uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16292024-12-12T22:34:38.441ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 resource = Database result = Ok(()) uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16302024-12-12T22:34:38.443ZDEBGnexus: Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
16312024-12-12T22:34:38.446ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
16322024-12-12T22:34:38.446ZDEBGnexus: resolved 2 rules for sleds
16332024-12-12T22:34:38.532ZDEBGnexus: resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 4a8c9490-d35a-4221-8585-e4103b325118, time_created: 2024-12-12T22:34:36.929491Z, time_modified: 2024-12-12T22:34:36.929491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
16342024-12-12T22:34:38.532ZDEBGnexus: sending firewall rules to sled agents
16352024-12-12T22:34:38.532ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
16362024-12-12T22:34:38.532ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
16372024-12-12T22:34:38.535ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {} }
16382024-12-12T22:34:38.535ZDEBGnexus (InstanceAllocator): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Database result = Ok(())
16392024-12-12T22:34:38.537ZDEBGnexus (InstanceAllocator): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "viewer")} }
16402024-12-12T22:34:38.539ZDEBGnexus (InstanceAllocator): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000004ead, .. }) resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
16412024-12-12T22:34:38.571ZDEBGnexus: client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
16422024-12-12T22:34:38.575ZDEBGnexus: client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "f39fa1ef-fc72-42eb-8cc2-c528c5d2470b", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
16432024-12-12T22:34:38.576ZINFOnexus: updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
16442024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 2 reason = Signaled
16452024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 2 reason = Signaled
16462024-12-12T22:34:38.576ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1237612 local_addr = [fd00:1122:3344:101::c]:12221 method = PUT remote_addr = [fd00:1122:3344:101::1]:38445 req_id = 01b19fb8-0ed1-4400-9241-77ab7b13d3c8 response_code = 204 uri = /racks/ceaea472-35b2-490f-a91b-ab350691945c/initialization-complete
16472024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 2 reason = Signaled
16482024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16492024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 2 reason = Signaled
16502024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 2 reason = Signaled
16512024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
16522024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16532024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16542024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 2 reason = Signaled
16552024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
16562024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16572024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16582024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16592024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16602024-12-12T22:34:38.576ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16612024-12-12T22:34:38.576ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3409, tv_nsec: 498743539 } })
16622024-12-12T22:34:38.577ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3409, tv_nsec: 498949073 } })
16632024-12-12T22:34:38.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
16642024-12-12T22:34:38.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.255974ms iteration = 2 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
16652024-12-12T22:34:38.577ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
16662024-12-12T22:34:38.577ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.52949ms iteration = 2 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
16672024-12-12T22:34:38.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16682024-12-12T22:34:38.578ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16692024-12-12T22:34:38.578ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16702024-12-12T22:34:38.578ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
16712024-12-12T22:34:38.578ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16722024-12-12T22:34:38.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
16732024-12-12T22:34:38.580ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16742024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
16752024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
16762024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
16772024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
16782024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16792024-12-12T22:34:38.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16802024-12-12T22:34:38.583ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16812024-12-12T22:34:38.583ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16822024-12-12T22:34:38.584ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16832024-12-12T22:34:38.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16842024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
16852024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16862024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
16872024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
16882024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
16892024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16902024-12-12T22:34:38.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16912024-12-12T22:34:38.588ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
16922024-12-12T22:34:38.588ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
16932024-12-12T22:34:38.588ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
16942024-12-12T22:34:38.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
16952024-12-12T22:34:38.591ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
16962024-12-12T22:34:38.591ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
16972024-12-12T22:34:38.591ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
16982024-12-12T22:34:38.593ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
16992024-12-12T22:34:38.593ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
17002024-12-12T22:34:38.593ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17012024-12-12T22:34:38.593ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17022024-12-12T22:34:38.594ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17032024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): inventory_prune_one: eligible for removal background_task = inventory_collection candidates = [(2d473607-e2da-4f1a-9125-72bfbaf56798, 0), (9c4d70a8-4fca-43c1-8792-d5cca7b33de0, 0), (2ce21300-7dcf-418c-a128-85db2b099fe9, 0), (c029b21e-d915-4f0d-b82b-7da93544911b, 0)] collection_id = 2d473607-e2da-4f1a-9125-72bfbaf56798
17042024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17052024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17062024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
17072024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
17082024-12-12T22:34:38.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
17092024-12-12T22:34:38.616ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
17102024-12-12T22:34:38.616ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
17112024-12-12T22:34:38.616ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
17122024-12-12T22:34:38.616ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17132024-12-12T22:34:38.616ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17142024-12-12T22:34:38.618ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
17152024-12-12T22:34:38.618ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
17162024-12-12T22:34:38.618ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_external dns_group = external file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 2
17172024-12-12T22:34:38.618ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17182024-12-12T22:34:38.618ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 42.057596ms iteration = 2 status = {"generation":2}
17192024-12-12T22:34:38.618ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 3 reason = Dependency
17202024-12-12T22:34:38.621ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17212024-12-12T22:34:38.621ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17222024-12-12T22:34:38.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17232024-12-12T22:34:38.623ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
17242024-12-12T22:34:38.623ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
17252024-12-12T22:34:38.623ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17262024-12-12T22:34:38.623ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17272024-12-12T22:34:38.624ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17282024-12-12T22:34:38.627ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
17292024-12-12T22:34:38.627ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
17302024-12-12T22:34:38.627ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
17312024-12-12T22:34:38.628ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17322024-12-12T22:34:38.628ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17332024-12-12T22:34:38.630ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
17342024-12-12T22:34:38.631ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
17352024-12-12T22:34:38.631ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
17362024-12-12T22:34:38.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
17372024-12-12T22:34:38.639ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
17382024-12-12T22:34:38.639ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
17392024-12-12T22:34:38.639ZINFOnexus (BackgroundTasks): found latest generation (first find) background_task = dns_config_internal dns_group = internal file = nexus/src/app/background/tasks/dns_config.rs:87 generation = 1
17402024-12-12T22:34:38.639ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 63.689011ms iteration = 2 status = {"generation":1}
17412024-12-12T22:34:38.639ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 3 reason = Dependency
17422024-12-12T22:34:38.657ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
17432024-12-12T22:34:38.666ZINFOnexus (BackgroundTasks): removed inventory collection background_task = inventory_collection collection_id = 2d473607-e2da-4f1a-9125-72bfbaf56798 file = nexus/db-queries/src/db/datastore/inventory.rs:1442 ncabooses = 12 nclickhouse_keeper_membership = 0 ncollections = 1 ndatasets = 0 nerrors = 0 nnics = 0 nnvme_disk_firmware = 0 nphysical_disks = 0 nrot_pages = 8 nrots = 2 nsled_agent_zones = 0 nsled_agents = 0 nsps = 2 nzones = 0 nzpools = 0
17442024-12-12T22:34:38.666ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
17452024-12-12T22:34:38.666ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
17462024-12-12T22:34:38.672ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(9c4d70a8-4fca-43c1-8792-d5cca7b33de0, 0), (2ce21300-7dcf-418c-a128-85db2b099fe9, 0), (c029b21e-d915-4f0d-b82b-7da93544911b, 0)]
17472024-12-12T22:34:38.672ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3409, tv_nsec: 594379067 } })
17482024-12-12T22:34:38.684ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (initial) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(1)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:77
17492024-12-12T22:34:38.684ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 108.346518ms iteration = 2 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
17502024-12-12T22:34:38.719ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
17512024-12-12T22:34:38.734ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
17522024-12-12T22:34:38.750ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
17532024-12-12T22:34:38.750ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
17542024-12-12T22:34:38.750ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
17552024-12-12T22:34:38.752ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "59101376-3dd1-45f4-870a-1968ff52301a", "content-length": "476", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17562024-12-12T22:34:38.752ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
17572024-12-12T22:34:38.752ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1644193b-5758-4549-94a6-2f02e7fc8a1e", "content-length": "734", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17582024-12-12T22:34:38.752ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
17592024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f53bb90b-d56c-448b-b652-c698691c4e9e", "content-length": "111", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17602024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
17612024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "59b0ee1d-1abd-43d9-a790-2b0e3d740494", "content-length": "111", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17622024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
17632024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f4a1115-b5cc-4ecb-b5c4-da14a79108c3", "content-length": "167", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17642024-12-12T22:34:38.753ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
17652024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "2a472c1a-d688-4c2f-99a2-9585855987ef", "content-length": "167", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17662024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
17672024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "6a954815-5871-4df4-a761-504abbebd2bb", "content-length": "175", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17682024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
17692024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "10a6adf1-c505-4144-b197-0c633da81505", "content-length": "175", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17702024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
17712024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0968063b-0548-40a1-8e4c-12ef999d7cff", "content-length": "702", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17722024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17732024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "83ea91c1-2263-4ebf-a634-67d31dca5fdd", "content-length": "727", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17742024-12-12T22:34:38.754ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17752024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "0486df8d-a97a-40de-aa70-2d38e487900c", "content-length": "729", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17762024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
17772024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "086e9349-8700-4a73-a55a-b5e079bd3913", "content-length": "728", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17782024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
17792024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "9f5046c3-89f9-45a9-90b1-f011b3f492e8", "content-length": "722", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17802024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
17812024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "440430fa-b1dd-4a5d-89b7-8e88c7eb5098", "content-length": "109", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17822024-12-12T22:34:38.755ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
17832024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ccaffc19-66e5-4d56-9e1c-373f19c7a02f", "content-length": "109", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17842024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
17852024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0f5fcdd7-6ae7-4004-922c-d1aeaa5db3e7", "content-length": "169", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17862024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
17872024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9cab898-3765-4f26-b280-5661716ad725", "content-length": "169", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17882024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
17892024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "ac7b686c-c088-4468-8d5f-760c452dcfbc", "content-length": "178", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17902024-12-12T22:34:38.756ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
17912024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "8e6197c0-47ae-44e8-8d1f-77512db5c329", "content-length": "178", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17922024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
17932024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d9db2f51-251c-491d-acc8-8b6cb5d61b3f", "content-length": "702", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17942024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17952024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "5bc4c981-9d40-4de0-a756-4baa6719016d", "content-length": "727", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17962024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17972024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "d6201cf1-c68d-4c00-b686-4c962433b4be", "content-length": "729", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
17982024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
17992024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "b826d421-41d4-48dd-a8a6-e4f1d37975f5", "content-length": "728", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
18002024-12-12T22:34:38.757ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18012024-12-12T22:34:38.758ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18022024-12-12T22:34:38.760ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18032024-12-12T22:34:38.762ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18042024-12-12T22:34:38.762ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18052024-12-12T22:34:38.763ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18062024-12-12T22:34:38.764ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18072024-12-12T22:34:38.766ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
18082024-12-12T22:34:38.766ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18092024-12-12T22:34:38.766ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18102024-12-12T22:34:38.772ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
18112024-12-12T22:34:38.774ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "a011b326-b048-470a-ae48-9af34b5254ac", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18122024-12-12T22:34:38.774ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18132024-12-12T22:34:38.777ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "286a80b9-f1fe-4078-9c79-59af151fff01", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18142024-12-12T22:34:38.777ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18152024-12-12T22:34:38.778ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
18162024-12-12T22:34:38.778ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 159.952511ms iteration = 3 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
18172024-12-12T22:34:38.811ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
18182024-12-12T22:34:38.832ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83405e12-596c-42af-bda3-981016590c75", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18192024-12-12T22:34:38.832ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18202024-12-12T22:34:38.835ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
18212024-12-12T22:34:38.835ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
18222024-12-12T22:34:38.835ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e60afcad-a98a-4b62-97a1-27a3c0e274de", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18232024-12-12T22:34:38.835ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18242024-12-12T22:34:38.837ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "4fcc8d26-2218-4279-b721-1b29a58c3ca5", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18252024-12-12T22:34:38.837ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18262024-12-12T22:34:38.839ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
18272024-12-12T22:34:38.839ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 199.740593ms iteration = 3 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
18282024-12-12T22:34:39.074ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "6c256326-6b00-4300-9594-9c203285401a", "content-length": "30411", "date": "Thu, 12 Dec 2024 22:34:39 GMT"} })
18292024-12-12T22:34:39.076ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
18302024-12-12T22:34:39.076ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
18312024-12-12T22:34:39.076ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
18322024-12-12T22:34:39.078ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18332024-12-12T22:34:39.078ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18342024-12-12T22:34:39.079ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18352024-12-12T22:34:39.081ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
18362024-12-12T22:34:39.082ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
18372024-12-12T22:34:39.082ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
18382024-12-12T22:34:39.352ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
18392024-12-12T22:34:39.352ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18402024-12-12T22:34:39.353ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {} }
18412024-12-12T22:34:39.354ZDEBGnexus (ServiceBalancer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Database result = Ok(())
18422024-12-12T22:34:39.355ZDEBGnexus (ServiceBalancer): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18432024-12-12T22:34:39.358ZDEBGnexus (ServiceBalancer): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-00000000bac3, .. }) resource = Rack { parent: Fleet, key: ceaea472-35b2-490f-a91b-ab350691945c, lookup_type: ById(ceaea472-35b2-490f-a91b-ab350691945c) } result = Ok(())
18442024-12-12T22:34:39.358ZINFOnexus: Rack initialized file = nexus/src/app/rack.rs:765
18452024-12-12T22:34:39.358ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18462024-12-12T22:34:39.358ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18472024-12-12T22:34:39.360ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18482024-12-12T22:34:39.361ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18492024-12-12T22:34:39.363ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18502024-12-12T22:34:39.363ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18512024-12-12T22:34:39.365ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18522024-12-12T22:34:39.365ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18532024-12-12T22:34:39.366ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18542024-12-12T22:34:39.366ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18552024-12-12T22:34:39.368ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18562024-12-12T22:34:39.368ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18572024-12-12T22:34:39.369ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18582024-12-12T22:34:39.372ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
18592024-12-12T22:34:39.372ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18602024-12-12T22:34:39.372ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18612024-12-12T22:34:39.374ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18622024-12-12T22:34:39.374ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18632024-12-12T22:34:39.375ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18642024-12-12T22:34:39.375ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18652024-12-12T22:34:39.377ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18662024-12-12T22:34:39.380ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
18672024-12-12T22:34:39.380ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18682024-12-12T22:34:39.380ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18692024-12-12T22:34:39.382ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18702024-12-12T22:34:39.382ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18712024-12-12T22:34:39.384ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18722024-12-12T22:34:39.384ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18732024-12-12T22:34:39.385ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18742024-12-12T22:34:39.385ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18752024-12-12T22:34:39.387ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18762024-12-12T22:34:39.387ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18772024-12-12T22:34:39.388ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18782024-12-12T22:34:39.388ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18792024-12-12T22:34:39.389ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18802024-12-12T22:34:39.389ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18812024-12-12T22:34:39.391ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18822024-12-12T22:34:39.394ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
18832024-12-12T22:34:39.394ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18842024-12-12T22:34:39.394ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18852024-12-12T22:34:39.396ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18862024-12-12T22:34:39.396ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18872024-12-12T22:34:39.397ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18882024-12-12T22:34:39.397ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18892024-12-12T22:34:39.399ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18902024-12-12T22:34:39.399ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18912024-12-12T22:34:39.401ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18922024-12-12T22:34:39.401ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18932024-12-12T22:34:39.403ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18942024-12-12T22:34:39.403ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18952024-12-12T22:34:39.404ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
18962024-12-12T22:34:39.405ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
18972024-12-12T22:34:39.406ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
18982024-12-12T22:34:39.407ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 6909cce4-7098-4f89-96e9-4f84fb85b683 file = nexus/db-queries/src/db/datastore/inventory.rs:1010
18992024-12-12T22:34:39.407ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 6909cce4-7098-4f89-96e9-4f84fb85b683 time_started = 2024-12-12 22:34:38.750705 UTC
19002024-12-12T22:34:39.407ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 831.207085ms iteration = 2 status = {"collection_id":"6909cce4-7098-4f89-96e9-4f84fb85b683","time_done":"2024-12-12 22:34:39.076292 UTC","time_started":"2024-12-12 22:34:38.750705 UTC"}
19012024-12-12T22:34:39.407ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 3 reason = Dependency
19022024-12-12T22:34:39.407ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19032024-12-12T22:34:39.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19042024-12-12T22:34:39.409ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19052024-12-12T22:34:39.410ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
19062024-12-12T22:34:39.410ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19072024-12-12T22:34:39.410ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19082024-12-12T22:34:39.411ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19092024-12-12T22:34:39.411ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19102024-12-12T22:34:39.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19112024-12-12T22:34:39.412ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19122024-12-12T22:34:39.412ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19132024-12-12T22:34:39.413ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19142024-12-12T22:34:39.413ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19152024-12-12T22:34:39.414ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19162024-12-12T22:34:39.414ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19172024-12-12T22:34:39.415ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19182024-12-12T22:34:39.415ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19192024-12-12T22:34:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
19202024-12-12T22:34:39.419ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
19212024-12-12T22:34:39.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
19222024-12-12T22:34:39.420ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
19232024-12-12T22:34:39.420ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19242024-12-12T22:34:39.420ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19252024-12-12T22:34:39.425ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19262024-12-12T22:34:39.425ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19272024-12-12T22:34:39.427ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19282024-12-12T22:34:39.427ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19292024-12-12T22:34:39.428ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19302024-12-12T22:34:39.428ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19312024-12-12T22:34:39.430ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19322024-12-12T22:34:39.430ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19332024-12-12T22:34:39.432ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19342024-12-12T22:34:39.432ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19352024-12-12T22:34:39.434ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19362024-12-12T22:34:39.434ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19372024-12-12T22:34:39.435ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19382024-12-12T22:34:39.435ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19392024-12-12T22:34:39.437ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19402024-12-12T22:34:39.440ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
19412024-12-12T22:34:39.440ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19422024-12-12T22:34:39.440ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19432024-12-12T22:34:39.442ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19442024-12-12T22:34:39.442ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19452024-12-12T22:34:39.443ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19462024-12-12T22:34:39.443ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19472024-12-12T22:34:39.445ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19482024-12-12T22:34:39.448ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
19492024-12-12T22:34:39.448ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19502024-12-12T22:34:39.448ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19512024-12-12T22:34:39.455ZDEBGnexus (InternalApi): resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
19522024-12-12T22:34:39.455ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19532024-12-12T22:34:39.455ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19542024-12-12T22:34:39.456ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19552024-12-12T22:34:39.457ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 49.508842ms iteration = 3 status = {"physical_disks_added":0}
19562024-12-12T22:34:39.458ZDEBGnexus (InternalApi): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Fleet result = Ok(())
19572024-12-12T22:34:39.458ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19582024-12-12T22:34:39.458ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19592024-12-12T22:34:39.472ZDEBGnexus (InternalApi): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified.
19602024-12-12T22:34:39.472ZDEBGnexus (InternalApi): resolved firewall rules for sled agents sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
19612024-12-12T22:34:39.472ZDEBGnexus (InternalApi): resolved 2 rules for sleds
19622024-12-12T22:34:39.497ZDEBGnexus (InternalApi): resolved sleds for vpc oxide-services vpc_to_sled = [Sled { identity: SledIdentity { id: 4a8c9490-d35a-4221-8585-e4103b325118, time_created: 2024-12-12T22:34:36.929491Z, time_modified: 2024-12-12T22:34:36.929491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
19632024-12-12T22:34:39.497ZDEBGnexus (InternalApi): sending firewall rules to sled agents
19642024-12-12T22:34:39.497ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19652024-12-12T22:34:39.497ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19662024-12-12T22:34:39.500ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {} }
19672024-12-12T22:34:39.500ZDEBGnexus (InternalApi): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Database result = Ok(())
19682024-12-12T22:34:39.502ZDEBGnexus (InternalApi): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
19692024-12-12T22:34:39.504ZDEBGnexus (InternalApi): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
19702024-12-12T22:34:39.535ZDEBGnexus (InternalApi): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
19712024-12-12T22:34:39.536ZDEBGnexus (InternalApi): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "52d71ca8-c094-471f-a3b0-b85a4816723b", "date": "Thu, 12 Dec 2024 22:34:38 GMT"} })
19722024-12-12T22:34:39.536ZINFOnexus (InternalApi): updated firewall rules on 1 sleds file = nexus/networking/src/firewall_rules.rs:496
19732024-12-12T22:34:39.536ZINFOnexus: plumbed initial IP allowlist file = nexus/src/app/allow_list.rs:161
19742024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = / versions = all
19752024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /access versions = all
19762024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /assets/{path} versions = all
19772024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/auth versions = all
19782024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/confirm versions = all
19792024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/success versions = all
19802024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /device/token versions = all
19812024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /device/verify versions = all
19822024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes versions = all
19832024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /experimental/v1/probes versions = all
19842024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /experimental/v1/probes/{probe} versions = all
19852024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /experimental/v1/probes/{probe} versions = all
19862024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /images versions = all
19872024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login versions = all
19882024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/local versions = all
19892024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
19902024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
19912024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
19922024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /lookup/{path} versions = all
19932024-12-12T22:34:39.549ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects/{path} versions = all
19942024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /projects-new versions = all
19952024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /settings/{path} versions = all
19962024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /system/{path} versions = all
19972024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /utilization versions = all
19982024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates versions = all
19992024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/certificates versions = all
20002024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/certificates/{certificate} versions = all
20012024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/certificates/{certificate} versions = all
20022024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks versions = all
20032024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks versions = all
20042024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/disks/{disk} versions = all
20052024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk} versions = all
20062024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write versions = all
20072024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
20082024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
20092024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/disks/{disk}/finalize versions = all
20102024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
20112024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips versions = all
20122024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips versions = all
20132024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
20142024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/floating-ips/{floating_ip} versions = all
20152024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
20162024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
20172024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
20182024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups versions = all
20192024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/groups/{group_id} versions = all
20202024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images versions = all
20212024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images versions = all
20222024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/images/{image} versions = all
20232024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/images/{image} versions = all
20242024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/demote versions = all
20252024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/images/{image}/promote versions = all
20262024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances versions = all
20272024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances versions = all
20282024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance} versions = all
20292024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance} versions = all
20302024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/instances/{instance} versions = all
20312024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/disks versions = all
20322024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/attach versions = all
20332024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/disks/detach versions = all
20342024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/external-ips versions = all
20352024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20362024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
20372024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/reboot versions = all
20382024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console versions = all
20392024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
20402024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
20412024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/start versions = all
20422024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/instances/{instance}/stop versions = all
20432024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-addresses versions = all
20442024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-addresses versions = all
20452024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
20462024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateway-ip-pools versions = all
20472024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateway-ip-pools versions = all
20482024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
20492024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways versions = all
20502024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/internet-gateways versions = all
20512024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
20522024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/internet-gateways/{gateway} versions = all
20532024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools versions = all
20542024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ip-pools/{pool} versions = all
20552024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/login/{silo_name}/local versions = all
20562024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/logout versions = all
20572024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me versions = all
20582024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/groups versions = all
20592024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys versions = all
20602024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/me/ssh-keys versions = all
20612024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
20622024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
20632024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/metrics/{metric_name} versions = all
20642024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces versions = all
20652024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/network-interfaces versions = all
20662024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/network-interfaces/{interface} versions = all
20672024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/network-interfaces/{interface} versions = all
20682024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/network-interfaces/{interface} versions = all
20692024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/ping versions = all
20702024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/policy versions = all
20712024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/policy versions = all
20722024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects versions = all
20732024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/projects versions = all
20742024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/projects/{project} versions = all
20752024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project} versions = all
20762024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project} versions = all
20772024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/projects/{project}/policy versions = all
20782024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/projects/{project}/policy versions = all
20792024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots versions = all
20802024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/snapshots versions = all
20812024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/snapshots/{snapshot} versions = all
20822024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/snapshots/{snapshot} versions = all
20832024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks versions = all
20842024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
20852024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks versions = all
20862024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
20872024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds versions = all
20882024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/sleds versions = all
20892024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
20902024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
20912024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
20922024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
20932024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
20942024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port versions = all
20952024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
20962024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
20972024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
20982024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches versions = all
20992024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
21002024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers versions = all
21012024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users versions = all
21022024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
21032024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
21042024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/identity-providers/saml versions = all
21052024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
21062024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools versions = all
21072024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools versions = all
21082024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
21092024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool} versions = all
21102024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool} versions = all
21112024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
21122024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
21132024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
21142024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
21152024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
21162024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21172024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
21182024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
21192024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service versions = all
21202024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/ip-pools-service/ranges versions = all
21212024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
21222024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
21232024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/metrics/{metric_name} versions = all
21242024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot versions = all
21252024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/address-lot versions = all
21262024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
21272024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
21282024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/allow-list versions = all
21292024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/allow-list versions = all
21302024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-disable versions = all
21312024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bfd-enable versions = all
21322024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bfd-status versions = all
21332024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp versions = all
21342024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp versions = all
21352024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/bgp versions = all
21362024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set versions = all
21372024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
21382024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
21392024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
21402024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-exported versions = all
21412024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-message-history versions = all
21422024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
21432024-12-12T22:34:39.550ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/bgp-status versions = all
21442024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/loopback-address versions = all
21452024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/loopback-address versions = all
21462024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
21472024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
21482024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings versions = all
21492024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/networking/switch-port-settings versions = all
21502024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
21512024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/policy versions = all
21522024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/policy versions = all
21532024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles versions = all
21542024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/roles/{role_name} versions = all
21552024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silo-quotas versions = all
21562024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos versions = all
21572024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/silos versions = all
21582024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/system/silos/{silo} versions = all
21592024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo} versions = all
21602024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
21612024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/policy versions = all
21622024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/policy versions = all
21632024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/silos/{silo}/quotas versions = all
21642024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
21652024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/system/timeseries/query versions = all
21662024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/timeseries/schemas versions = all
21672024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/system/update/repository versions = all
21682024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/update/repository/{system_version} versions = all
21692024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users versions = all
21702024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users/{user_id} versions = all
21712024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin versions = all
21722024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/users-builtin/{user} versions = all
21732024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos versions = all
21742024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/system/utilization/silos/{silo} versions = all
21752024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/timeseries/query versions = all
21762024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/users versions = all
21772024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/utilization versions = all
21782024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-firewall-rules versions = all
21792024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-firewall-rules versions = all
21802024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes versions = all
21812024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-router-routes versions = all
21822024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
21832024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-router-routes/{route} versions = all
21842024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-router-routes/{route} versions = all
21852024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers versions = all
21862024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-routers versions = all
21872024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-routers/{router} versions = all
21882024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-routers/{router} versions = all
21892024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-routers/{router} versions = all
21902024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets versions = all
21912024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpc-subnets versions = all
21922024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
21932024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet} versions = all
21942024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
21952024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
21962024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs versions = all
21972024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = POST path = /v1/vpcs versions = all
21982024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = DELETE path = /v1/vpcs/{vpc} versions = all
21992024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = GET path = /v1/vpcs/{vpc} versions = all
22002024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): registered endpoint local_addr = 172.30.2.7:443 method = PUT path = /v1/vpcs/{vpc} versions = all
22012024-12-12T22:34:39.551ZINFOnexus (dropshot_external): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = 172.30.2.7:443
22022024-12-12T22:34:39.551ZDEBGnexus (dropshot_external): successfully registered DTrace USDT probes local_addr = 172.30.2.7:443
22032024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = / versions = all
22042024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /access versions = all
22052024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /assets/{path} versions = all
22062024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/auth versions = all
22072024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/confirm versions = all
22082024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/success versions = all
22092024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /device/token versions = all
22102024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /device/verify versions = all
22112024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes versions = all
22122024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /experimental/v1/probes versions = all
22132024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /experimental/v1/probes/{probe} versions = all
22142024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /experimental/v1/probes/{probe} versions = all
22152024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /images versions = all
22162024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login versions = all
22172024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/local versions = all
22182024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name} versions = all
22192024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /login/{silo_name}/saml/{provider_name} versions = all
22202024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /login/{silo_name}/saml/{provider_name}/redirect versions = all
22212024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /lookup/{path} versions = all
22222024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects/{path} versions = all
22232024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /projects-new versions = all
22242024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /settings/{path} versions = all
22252024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /system/{path} versions = all
22262024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /utilization versions = all
22272024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates versions = all
22282024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/certificates versions = all
22292024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/certificates/{certificate} versions = all
22302024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/certificates/{certificate} versions = all
22312024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks versions = all
22322024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks versions = all
22332024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/disks/{disk} versions = all
22342024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk} versions = all
22352024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write versions = all
22362024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-start versions = all
22372024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/bulk-write-stop versions = all
22382024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/disks/{disk}/finalize versions = all
22392024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/disks/{disk}/metrics/{metric} versions = all
22402024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips versions = all
22412024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips versions = all
22422024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/floating-ips/{floating_ip} versions = all
22432024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/floating-ips/{floating_ip} versions = all
22442024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/floating-ips/{floating_ip} versions = all
22452024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/attach versions = all
22462024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/floating-ips/{floating_ip}/detach versions = all
22472024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups versions = all
22482024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/groups/{group_id} versions = all
22492024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images versions = all
22502024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images versions = all
22512024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/images/{image} versions = all
22522024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/images/{image} versions = all
22532024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/demote versions = all
22542024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/images/{image}/promote versions = all
22552024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances versions = all
22562024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances versions = all
22572024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance} versions = all
22582024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance} versions = all
22592024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/instances/{instance} versions = all
22602024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/disks versions = all
22612024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/attach versions = all
22622024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/disks/detach versions = all
22632024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/external-ips versions = all
22642024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22652024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/external-ips/ephemeral versions = all
22662024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/reboot versions = all
22672024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console versions = all
22682024-12-12T22:34:39.555ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/serial-console/stream versions = all
22692024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/instances/{instance}/ssh-public-keys versions = all
22702024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/start versions = all
22712024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/instances/{instance}/stop versions = all
22722024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-addresses versions = all
22732024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-addresses versions = all
22742024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-addresses/{address} versions = all
22752024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateway-ip-pools versions = all
22762024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateway-ip-pools versions = all
22772024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateway-ip-pools/{pool} versions = all
22782024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways versions = all
22792024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/internet-gateways versions = all
22802024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/internet-gateways/{gateway} versions = all
22812024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/internet-gateways/{gateway} versions = all
22822024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools versions = all
22832024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ip-pools/{pool} versions = all
22842024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/login/{silo_name}/local versions = all
22852024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/logout versions = all
22862024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me versions = all
22872024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/groups versions = all
22882024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys versions = all
22892024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/me/ssh-keys versions = all
22902024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/me/ssh-keys/{ssh_key} versions = all
22912024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/me/ssh-keys/{ssh_key} versions = all
22922024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/metrics/{metric_name} versions = all
22932024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces versions = all
22942024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/network-interfaces versions = all
22952024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/network-interfaces/{interface} versions = all
22962024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/network-interfaces/{interface} versions = all
22972024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/network-interfaces/{interface} versions = all
22982024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/ping versions = all
22992024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/policy versions = all
23002024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/policy versions = all
23012024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects versions = all
23022024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/projects versions = all
23032024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/projects/{project} versions = all
23042024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project} versions = all
23052024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project} versions = all
23062024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/projects/{project}/policy versions = all
23072024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/projects/{project}/policy versions = all
23082024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots versions = all
23092024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/snapshots versions = all
23102024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/snapshots/{snapshot} versions = all
23112024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/snapshots/{snapshot} versions = all
23122024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks versions = all
23132024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/disks/{disk_id} versions = all
23142024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks versions = all
23152024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/racks/{rack_id} versions = all
23162024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds versions = all
23172024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/sleds versions = all
23182024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id} versions = all
23192024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/disks versions = all
23202024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds/{sled_id}/instances versions = all
23212024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/hardware/sleds/{sled_id}/provision-policy versions = all
23222024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/sleds-uninitialized versions = all
23232024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port versions = all
23242024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/hardware/switch-port/{port}/settings versions = all
23252024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/hardware/switch-port/{port}/settings versions = all
23262024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switch-port/{port}/status versions = all
23272024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches versions = all
23282024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/hardware/switches/{switch_id} versions = all
23292024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers versions = all
23302024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users versions = all
23312024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/identity-providers/local/users/{user_id} versions = all
23322024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/local/users/{user_id}/set-password versions = all
23332024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/identity-providers/saml versions = all
23342024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/identity-providers/saml/{provider} versions = all
23352024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools versions = all
23362024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools versions = all
23372024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool} versions = all
23382024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool} versions = all
23392024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool} versions = all
23402024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/ranges versions = all
23412024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/add versions = all
23422024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/ranges/remove versions = all
23432024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/silos versions = all
23442024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools/{pool}/silos versions = all
23452024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23462024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/ip-pools/{pool}/silos/{silo} versions = all
23472024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools/{pool}/utilization versions = all
23482024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service versions = all
23492024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/ip-pools-service/ranges versions = all
23502024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/add versions = all
23512024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/ip-pools-service/ranges/remove versions = all
23522024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/metrics/{metric_name} versions = all
23532024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot versions = all
23542024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/address-lot versions = all
23552024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/address-lot/{address_lot} versions = all
23562024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/address-lot/{address_lot}/blocks versions = all
23572024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/allow-list versions = all
23582024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/allow-list versions = all
23592024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-disable versions = all
23602024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bfd-enable versions = all
23612024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bfd-status versions = all
23622024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp versions = all
23632024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp versions = all
23642024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/bgp versions = all
23652024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set versions = all
23662024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/networking/bgp-announce-set versions = all
23672024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/bgp-announce-set/{announce_set} versions = all
23682024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-announce-set/{announce_set}/announcement versions = all
23692024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-exported versions = all
23702024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-message-history versions = all
23712024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-routes-ipv4 versions = all
23722024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/bgp-status versions = all
23732024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/loopback-address versions = all
23742024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/loopback-address versions = all
23752024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/loopback-address/{rack_id}/{switch_location}/{address}/{subnet_mask} versions = all
23762024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/networking/switch-port-settings versions = all
23772024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings versions = all
23782024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/networking/switch-port-settings versions = all
23792024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/networking/switch-port-settings/{port} versions = all
23802024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/policy versions = all
23812024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/policy versions = all
23822024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles versions = all
23832024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/roles/{role_name} versions = all
23842024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silo-quotas versions = all
23852024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos versions = all
23862024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/silos versions = all
23872024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/system/silos/{silo} versions = all
23882024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo} versions = all
23892024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/ip-pools versions = all
23902024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/policy versions = all
23912024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/policy versions = all
23922024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/silos/{silo}/quotas versions = all
23932024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/silos/{silo}/quotas versions = all
23942024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/system/timeseries/query versions = all
23952024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/timeseries/schemas versions = all
23962024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/system/update/repository versions = all
23972024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/update/repository/{system_version} versions = all
23982024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users versions = all
23992024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users/{user_id} versions = all
24002024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin versions = all
24012024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/users-builtin/{user} versions = all
24022024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos versions = all
24032024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/system/utilization/silos/{silo} versions = all
24042024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/timeseries/query versions = all
24052024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/users versions = all
24062024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/utilization versions = all
24072024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-firewall-rules versions = all
24082024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-firewall-rules versions = all
24092024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes versions = all
24102024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-router-routes versions = all
24112024-12-12T22:34:39.556ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-router-routes/{route} versions = all
24122024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-router-routes/{route} versions = all
24132024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-router-routes/{route} versions = all
24142024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers versions = all
24152024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-routers versions = all
24162024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-routers/{router} versions = all
24172024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-routers/{router} versions = all
24182024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-routers/{router} versions = all
24192024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets versions = all
24202024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpc-subnets versions = all
24212024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpc-subnets/{subnet} versions = all
24222024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet} versions = all
24232024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpc-subnets/{subnet} versions = all
24242024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpc-subnets/{subnet}/network-interfaces versions = all
24252024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs versions = all
24262024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = POST path = /v1/vpcs versions = all
24272024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = DELETE path = /v1/vpcs/{vpc} versions = all
24282024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = GET path = /v1/vpcs/{vpc} versions = all
24292024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): registered endpoint local_addr = [fd00:1122:3344:101::c]:12228 method = PUT path = /v1/vpcs/{vpc} versions = all
24302024-12-12T22:34:39.557ZINFOnexus (dropshot_external_techport): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:12228
24312024-12-12T22:34:39.557ZDEBGnexus (dropshot_external_techport): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:12228
24322024-12-12T22:34:39.558ZDEBGnexus (nexus-producer-server): registered DTrace probes
24332024-12-12T22:34:39.561ZDEBGnexus (dropshot): registered endpoint local_addr = [fd00:1122:3344:101::c]:43664 method = GET path = /{producer_id} versions = all
24342024-12-12T22:34:39.561ZINFOnexus (dropshot): listening file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:327 local_addr = [fd00:1122:3344:101::c]:43664
24352024-12-12T22:34:39.561ZDEBGnexus (dropshot): successfully registered DTrace USDT probes local_addr = [fd00:1122:3344:101::c]:43664
24362024-12-12T22:34:39.561ZDEBGnexus (nexus-producer-server): Requested any available port, Dropshot server has been bound to [fd00:1122:3344:101::c]:43664
24372024-12-12T22:34:39.561ZDEBGnexus (nexus-producer-server): Nexus IP provided explicitly, will use it addr = [fd00:1122:3344:101::c]:12221
24382024-12-12T22:34:39.561ZDEBGnexus (nexus-producer-server): starting producer registration task
24392024-12-12T22:34:39.562ZINFOnexus (nexus-producer-server): starting oximeter metric producer server address = [fd00:1122:3344:101::c]:43664 file = oximeter/producer/src/lib.rs:279 interval = 10s producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
24402024-12-12T22:34:39.562ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
24412024-12-12T22:34:39.562ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
24422024-12-12T22:34:39.593ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
24432024-12-12T22:34:39.594ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:41819
24442024-12-12T22:34:39.594ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41819 req_id = 066bf884-6f79-45cf-b552-88c17f0d5d40 roles = RoleSet { roles: {} } uri = /metrics/producers
24452024-12-12T22:34:39.594ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41819 req_id = 066bf884-6f79-45cf-b552-88c17f0d5d40 resource = Database result = Ok(()) uri = /metrics/producers
24462024-12-12T22:34:39.635ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
24472024-12-12T22:34:39.636ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 41691 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:41819 req_id = 066bf884-6f79-45cf-b552-88c17f0d5d40 response_code = 201 uri = /metrics/producers
24482024-12-12T22:34:39.636ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "066bf884-6f79-45cf-b552-88c17f0d5d40", "content-length": "41", "date": "Thu, 12 Dec 2024 22:34:39 GMT"} })
24492024-12-12T22:34:39.636ZDEBGnexus (producer-registration-task): registered with nexus successfully
24502024-12-12T22:34:39.636ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
24512024-12-12T22:34:40.222ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" } server_name = recovery.sys.oxide.test silo_id = 207f2d86-9d5c-4ed8-9fa3-55f780829af6
24522024-12-12T22:34:40.229ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.7:443 remote_addr = 10.151.2.100:54570
24532024-12-12T22:34:40.238ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24542024-12-12T22:34:40.239ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24552024-12-12T22:34:40.242ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24562024-12-12T22:34:40.242ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24572024-12-12T22:34:40.244ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24582024-12-12T22:34:40.244ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24592024-12-12T22:34:40.246ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24602024-12-12T22:34:40.248ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") } result = Ok(())
24612024-12-12T22:34:40.248ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24622024-12-12T22:34:40.248ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24632024-12-12T22:34:40.249ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24642024-12-12T22:34:40.250ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24652024-12-12T22:34:40.251ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24662024-12-12T22:34:40.254ZDEBGnexus (ExternalAuthn): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") } result = Ok(())
24672024-12-12T22:34:40.254ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24682024-12-12T22:34:40.254ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24692024-12-12T22:34:40.257ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24702024-12-12T22:34:40.257ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24712024-12-12T22:34:40.258ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24722024-12-12T22:34:40.259ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24732024-12-12T22:34:40.260ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24742024-12-12T22:34:40.261ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ByName("recovery") } result = Ok(())
24752024-12-12T22:34:40.261ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24762024-12-12T22:34:40.261ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24772024-12-12T22:34:40.974ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24782024-12-12T22:34:40.974ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24792024-12-12T22:34:40.982ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24802024-12-12T22:34:40.983ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24812024-12-12T22:34:40.984ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24822024-12-12T22:34:40.985ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24832024-12-12T22:34:40.987ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24842024-12-12T22:34:40.987ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24852024-12-12T22:34:40.989ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24862024-12-12T22:34:40.991ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
24872024-12-12T22:34:40.991ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24882024-12-12T22:34:40.991ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24892024-12-12T22:34:40.993ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
24902024-12-12T22:34:40.994ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSessionList result = Ok(())
24912024-12-12T22:34:40.994ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24922024-12-12T22:34:40.995ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24932024-12-12T22:34:41.004ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 769479 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:54570 req_id = 566f0583-0941-4462-b791-49fa5a42ca26 response_code = 204 uri = /v1/login/recovery/local
24942024-12-12T22:34:41.047ZDEBGnexus (NexusCertResolver): resolved TLS certificate certificate = TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" } server_name = recovery.sys.oxide.test silo_id = 207f2d86-9d5c-4ed8-9fa3-55f780829af6
24952024-12-12T22:34:41.052ZINFOnexus (dropshot_external): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = 172.30.2.7:443 remote_addr = 10.151.2.100:42495
24962024-12-12T22:34:41.054ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24972024-12-12T22:34:41.054ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
24982024-12-12T22:34:41.056ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
24992024-12-12T22:34:41.056ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25002024-12-12T22:34:41.058ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25012024-12-12T22:34:41.059ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
25022024-12-12T22:34:41.059ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25032024-12-12T22:34:41.059ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25042024-12-12T22:34:41.061ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25052024-12-12T22:34:41.062ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25062024-12-12T22:34:41.063ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25072024-12-12T22:34:41.063ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25082024-12-12T22:34:41.064ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25092024-12-12T22:34:41.065ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25102024-12-12T22:34:41.066ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25112024-12-12T22:34:41.068ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
25122024-12-12T22:34:41.068ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25132024-12-12T22:34:41.068ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25142024-12-12T22:34:41.069ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25152024-12-12T22:34:41.070ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
25162024-12-12T22:34:41.070ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25172024-12-12T22:34:41.070ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25182024-12-12T22:34:41.074ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25192024-12-12T22:34:41.075ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25202024-12-12T22:34:41.076ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25212024-12-12T22:34:41.077ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25222024-12-12T22:34:41.079ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25232024-12-12T22:34:41.079ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25242024-12-12T22:34:41.081ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25252024-12-12T22:34:41.081ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25262024-12-12T22:34:41.082ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25272024-12-12T22:34:41.083ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
25282024-12-12T22:34:41.083ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25292024-12-12T22:34:41.083ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25302024-12-12T22:34:41.085ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25312024-12-12T22:34:41.085ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25322024-12-12T22:34:41.087ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25332024-12-12T22:34:41.087ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25342024-12-12T22:34:41.088ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25352024-12-12T22:34:41.089ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
25362024-12-12T22:34:41.089ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 roles = RoleSet { roles: {} } uri = /v1/projects
25372024-12-12T22:34:41.089ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 resource = Database result = Ok(()) uri = /v1/projects
25382024-12-12T22:34:41.095ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 roles = RoleSet { roles: {} } uri = /v1/projects
25392024-12-12T22:34:41.096ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 resource = Database result = Ok(()) uri = /v1/projects
25402024-12-12T22:34:41.099ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 roles = RoleSet { roles: {} } uri = /v1/projects
25412024-12-12T22:34:41.099ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 resource = Database result = Ok(()) uri = /v1/projects
25422024-12-12T22:34:41.103ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/projects
25432024-12-12T22:34:41.105ZDEBGnexus (dropshot_external): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(()) uri = /v1/projects
25442024-12-12T22:34:41.105ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 roles = RoleSet { roles: {} } uri = /v1/projects
25452024-12-12T22:34:41.105ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 resource = Database result = Ok(()) uri = /v1/projects
25462024-12-12T22:34:41.107ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 54824 local_addr = 172.30.2.7:443 method = GET remote_addr = 10.151.2.100:42495 req_id = 7b4c653f-9076-4347-abdc-2f93ae7b5474 response_code = 200 uri = /v1/projects
25472024-12-12T22:34:41.113ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25482024-12-12T22:34:41.113ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25492024-12-12T22:34:41.114ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25502024-12-12T22:34:41.114ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25512024-12-12T22:34:41.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25522024-12-12T22:34:41.117ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
25532024-12-12T22:34:41.117ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25542024-12-12T22:34:41.117ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25552024-12-12T22:34:41.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25562024-12-12T22:34:41.119ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25572024-12-12T22:34:41.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25582024-12-12T22:34:41.121ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25592024-12-12T22:34:41.122ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25602024-12-12T22:34:41.122ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25612024-12-12T22:34:41.123ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25622024-12-12T22:34:41.125ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
25632024-12-12T22:34:41.125ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25642024-12-12T22:34:41.125ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25652024-12-12T22:34:41.127ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25662024-12-12T22:34:41.128ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
25672024-12-12T22:34:41.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25682024-12-12T22:34:41.128ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25692024-12-12T22:34:41.133ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25702024-12-12T22:34:41.133ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25712024-12-12T22:34:41.135ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25722024-12-12T22:34:41.135ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25732024-12-12T22:34:41.136ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25742024-12-12T22:34:41.136ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25752024-12-12T22:34:41.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25762024-12-12T22:34:41.138ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25772024-12-12T22:34:41.139ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25782024-12-12T22:34:41.140ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
25792024-12-12T22:34:41.140ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25802024-12-12T22:34:41.141ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25812024-12-12T22:34:41.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25822024-12-12T22:34:41.142ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25832024-12-12T22:34:41.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25842024-12-12T22:34:41.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25852024-12-12T22:34:41.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
25862024-12-12T22:34:41.146ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
25872024-12-12T22:34:41.147ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25882024-12-12T22:34:41.147ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 resource = Database result = Ok(()) uri = /v1/system/ip-pools
25892024-12-12T22:34:41.159ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25902024-12-12T22:34:41.159ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 resource = Database result = Ok(()) uri = /v1/system/ip-pools
25912024-12-12T22:34:41.161ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools
25922024-12-12T22:34:41.163ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools
25932024-12-12T22:34:41.164ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools
25942024-12-12T22:34:41.164ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 resource = Database result = Ok(()) uri = /v1/system/ip-pools
25952024-12-12T22:34:41.173ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61494 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 9c85088e-fa40-4ad8-94c9-9388bccc1ef1 response_code = 201 uri = /v1/system/ip-pools
25962024-12-12T22:34:41.179ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25972024-12-12T22:34:41.179ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
25982024-12-12T22:34:41.181ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
25992024-12-12T22:34:41.181ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26002024-12-12T22:34:41.185ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26012024-12-12T22:34:41.186ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
26022024-12-12T22:34:41.186ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26032024-12-12T22:34:41.186ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26042024-12-12T22:34:41.187ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26052024-12-12T22:34:41.188ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26062024-12-12T22:34:41.189ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26072024-12-12T22:34:41.190ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26082024-12-12T22:34:41.191ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26092024-12-12T22:34:41.191ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26102024-12-12T22:34:41.193ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26112024-12-12T22:34:41.194ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
26122024-12-12T22:34:41.194ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26132024-12-12T22:34:41.194ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26142024-12-12T22:34:41.196ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26152024-12-12T22:34:41.197ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
26162024-12-12T22:34:41.197ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26172024-12-12T22:34:41.197ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26182024-12-12T22:34:41.202ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26192024-12-12T22:34:41.203ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26202024-12-12T22:34:41.205ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26212024-12-12T22:34:41.205ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26222024-12-12T22:34:41.206ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26232024-12-12T22:34:41.207ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26242024-12-12T22:34:41.208ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26252024-12-12T22:34:41.208ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26262024-12-12T22:34:41.209ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26272024-12-12T22:34:41.211ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
26282024-12-12T22:34:41.211ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26292024-12-12T22:34:41.211ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26302024-12-12T22:34:41.212ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26312024-12-12T22:34:41.212ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26322024-12-12T22:34:41.213ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26332024-12-12T22:34:41.214ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26342024-12-12T22:34:41.215ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26352024-12-12T22:34:41.216ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
26362024-12-12T22:34:41.216ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26372024-12-12T22:34:41.216ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26382024-12-12T22:34:41.218ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26392024-12-12T22:34:41.218ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26402024-12-12T22:34:41.222ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26412024-12-12T22:34:41.222ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26422024-12-12T22:34:41.224ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools/default/silos
26432024-12-12T22:34:41.226ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = IpPool { parent: Fleet, key: 77a48636-d101-462d-980e-453bdbb9f564, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26442024-12-12T22:34:41.226ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26452024-12-12T22:34:41.226ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26462024-12-12T22:34:41.228ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26472024-12-12T22:34:41.228ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26482024-12-12T22:34:41.230ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26492024-12-12T22:34:41.230ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26502024-12-12T22:34:41.233ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26512024-12-12T22:34:41.233ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26522024-12-12T22:34:41.235ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26532024-12-12T22:34:41.235ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26542024-12-12T22:34:41.237ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools/default/silos
26552024-12-12T22:34:41.238ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/ip-pools/default/silos
26562024-12-12T22:34:41.238ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26572024-12-12T22:34:41.239ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26582024-12-12T22:34:41.241ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26592024-12-12T22:34:41.241ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26602024-12-12T22:34:41.243ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools/default/silos
26612024-12-12T22:34:41.245ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = IpPoolList result = Ok(()) uri = /v1/system/ip-pools/default/silos
26622024-12-12T22:34:41.245ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/silos
26632024-12-12T22:34:41.245ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/silos
26642024-12-12T22:34:41.300ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 121903 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 31215e4a-c94f-43ee-b05f-dc4f5eb07803 response_code = 201 uri = /v1/system/ip-pools/default/silos
26652024-12-12T22:34:41.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26662024-12-12T22:34:41.302ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26672024-12-12T22:34:41.304ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26682024-12-12T22:34:41.305ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26692024-12-12T22:34:41.306ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26702024-12-12T22:34:41.307ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
26712024-12-12T22:34:41.307ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26722024-12-12T22:34:41.307ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26732024-12-12T22:34:41.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26742024-12-12T22:34:41.309ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26752024-12-12T22:34:41.310ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26762024-12-12T22:34:41.311ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26772024-12-12T22:34:41.312ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26782024-12-12T22:34:41.312ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26792024-12-12T22:34:41.313ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26802024-12-12T22:34:41.315ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
26812024-12-12T22:34:41.315ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26822024-12-12T22:34:41.315ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26832024-12-12T22:34:41.316ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26842024-12-12T22:34:41.317ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
26852024-12-12T22:34:41.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26862024-12-12T22:34:41.317ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26872024-12-12T22:34:41.322ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26882024-12-12T22:34:41.322ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26892024-12-12T22:34:41.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26902024-12-12T22:34:41.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26912024-12-12T22:34:41.325ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26922024-12-12T22:34:41.325ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26932024-12-12T22:34:41.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26942024-12-12T22:34:41.326ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26952024-12-12T22:34:41.327ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
26962024-12-12T22:34:41.329ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
26972024-12-12T22:34:41.329ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
26982024-12-12T22:34:41.329ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
26992024-12-12T22:34:41.330ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27002024-12-12T22:34:41.331ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27012024-12-12T22:34:41.332ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27022024-12-12T22:34:41.332ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27032024-12-12T22:34:41.333ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27042024-12-12T22:34:41.335ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
27052024-12-12T22:34:41.335ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27062024-12-12T22:34:41.335ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27072024-12-12T22:34:41.337ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27082024-12-12T22:34:41.337ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27092024-12-12T22:34:41.338ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27102024-12-12T22:34:41.339ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27112024-12-12T22:34:41.341ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
27122024-12-12T22:34:41.343ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = IpPool { parent: Fleet, key: 77a48636-d101-462d-980e-453bdbb9f564, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27132024-12-12T22:34:41.343ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27142024-12-12T22:34:41.343ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27152024-12-12T22:34:41.345ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27162024-12-12T22:34:41.345ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27172024-12-12T22:34:41.346ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27182024-12-12T22:34:41.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27192024-12-12T22:34:41.348ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {} } uri = /v1/system/ip-pools/default/ranges/add
27202024-12-12T22:34:41.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = Database result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27212024-12-12T22:34:41.350ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/ip-pools/default/ranges/add
27222024-12-12T22:34:41.351ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda resource = IpPool { parent: Fleet, key: 77a48636-d101-462d-980e-453bdbb9f564, lookup_type: ByName("default") } result = Ok(()) uri = /v1/system/ip-pools/default/ranges/add
27232024-12-12T22:34:41.363ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 61026 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 7fe4c0bd-8618-4bc9-b3a8-58cf2ffc8dda response_code = 201 uri = /v1/system/ip-pools/default/ranges/add
27242024-12-12T22:34:41.370ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27252024-12-12T22:34:41.371ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27262024-12-12T22:34:41.372ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27272024-12-12T22:34:41.372ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27282024-12-12T22:34:41.373ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27292024-12-12T22:34:41.374ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
27302024-12-12T22:34:41.374ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27312024-12-12T22:34:41.375ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27322024-12-12T22:34:41.376ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27332024-12-12T22:34:41.376ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27342024-12-12T22:34:41.377ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27352024-12-12T22:34:41.378ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27362024-12-12T22:34:41.379ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27372024-12-12T22:34:41.379ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27382024-12-12T22:34:41.380ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27392024-12-12T22:34:41.382ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
27402024-12-12T22:34:41.382ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27412024-12-12T22:34:41.382ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27422024-12-12T22:34:41.383ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27432024-12-12T22:34:41.384ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
27442024-12-12T22:34:41.384ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27452024-12-12T22:34:41.384ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27462024-12-12T22:34:41.390ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27472024-12-12T22:34:41.391ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27482024-12-12T22:34:41.392ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27492024-12-12T22:34:41.392ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27502024-12-12T22:34:41.393ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27512024-12-12T22:34:41.393ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27522024-12-12T22:34:41.394ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27532024-12-12T22:34:41.395ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27542024-12-12T22:34:41.396ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27552024-12-12T22:34:41.397ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
27562024-12-12T22:34:41.397ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27572024-12-12T22:34:41.397ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27582024-12-12T22:34:41.399ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27592024-12-12T22:34:41.399ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27602024-12-12T22:34:41.401ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27612024-12-12T22:34:41.401ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27622024-12-12T22:34:41.402ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27632024-12-12T22:34:41.404ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
27642024-12-12T22:34:41.404ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27652024-12-12T22:34:41.404ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27662024-12-12T22:34:41.406ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27672024-12-12T22:34:41.406ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27682024-12-12T22:34:41.408ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27692024-12-12T22:34:41.408ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27702024-12-12T22:34:41.411ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27712024-12-12T22:34:41.411ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27722024-12-12T22:34:41.413ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/silos/recovery/quotas
27732024-12-12T22:34:41.414ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27742024-12-12T22:34:41.414ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27752024-12-12T22:34:41.414ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27762024-12-12T22:34:41.416ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27772024-12-12T22:34:41.416ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27782024-12-12T22:34:41.418ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27792024-12-12T22:34:41.419ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27802024-12-12T22:34:41.421ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/system/silos/recovery/quotas
27812024-12-12T22:34:41.422ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ByName("recovery") } result = Ok(()) uri = /v1/system/silos/recovery/quotas
27822024-12-12T22:34:41.422ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b roles = RoleSet { roles: {} } uri = /v1/system/silos/recovery/quotas
27832024-12-12T22:34:41.422ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b resource = Database result = Ok(()) uri = /v1/system/silos/recovery/quotas
27842024-12-12T22:34:41.429ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 58383 local_addr = 172.30.2.7:443 method = PUT remote_addr = 10.151.2.100:42495 req_id = 13403cca-030a-4312-9165-61ae6f19719b response_code = 200 uri = /v1/system/silos/recovery/quotas
27852024-12-12T22:34:41.432ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27862024-12-12T22:34:41.432ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27872024-12-12T22:34:41.434ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27882024-12-12T22:34:41.434ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27892024-12-12T22:34:41.435ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
27902024-12-12T22:34:41.436ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
27912024-12-12T22:34:41.436ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27922024-12-12T22:34:41.436ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27932024-12-12T22:34:41.438ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27942024-12-12T22:34:41.438ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27952024-12-12T22:34:41.439ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27962024-12-12T22:34:41.440ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27972024-12-12T22:34:41.441ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
27982024-12-12T22:34:41.441ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
27992024-12-12T22:34:41.443ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28002024-12-12T22:34:41.444ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
28012024-12-12T22:34:41.444ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28022024-12-12T22:34:41.444ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28032024-12-12T22:34:41.445ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28042024-12-12T22:34:41.446ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
28052024-12-12T22:34:41.446ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28062024-12-12T22:34:41.446ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28072024-12-12T22:34:41.450ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28082024-12-12T22:34:41.450ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28092024-12-12T22:34:41.451ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28102024-12-12T22:34:41.451ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28112024-12-12T22:34:41.455ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28122024-12-12T22:34:41.455ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28132024-12-12T22:34:41.457ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28142024-12-12T22:34:41.457ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28152024-12-12T22:34:41.458ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28162024-12-12T22:34:41.459ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
28172024-12-12T22:34:41.459ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28182024-12-12T22:34:41.459ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28192024-12-12T22:34:41.461ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28202024-12-12T22:34:41.461ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28212024-12-12T22:34:41.462ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
28222024-12-12T22:34:41.463ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
28232024-12-12T22:34:41.464ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
28242024-12-12T22:34:41.465ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
28252024-12-12T22:34:41.465ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 roles = RoleSet { roles: {} } uri = /v1/projects
28262024-12-12T22:34:41.465ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 resource = Database result = Ok(()) uri = /v1/projects
28272024-12-12T22:34:41.468ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 roles = RoleSet { roles: {} } uri = /v1/projects
28282024-12-12T22:34:41.468ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 resource = Database result = Ok(()) uri = /v1/projects
28292024-12-12T22:34:41.470ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 roles = RoleSet { roles: {} } uri = /v1/projects
28302024-12-12T22:34:41.470ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 resource = Database result = Ok(()) uri = /v1/projects
28312024-12-12T22:34:41.472ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/projects
28322024-12-12T22:34:41.474ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(()) uri = /v1/projects
28332024-12-12T22:34:41.475ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create
28342024-12-12T22:34:41.475ZINFOnexus (SEC): saga create dag = {"end_node":19,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[11,12,null],[12,13,null],[13,14,null],[14,15,null],[15,16,null],[2,3,null],[16,17,null],[18,0,null],[17,19,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"project_create.project_create_record","label":"ProjectCreateRecord","name":"project"}},{"Action":{"action_name":"project_create.project_create_vpc_params","label":"ProjectCreateVpcParams","name":"vpc_create_params"}},{"SubsagaStart":{"params_node_name":"vpc_create_params","saga_name":"vpc-create"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVpcId","name":"vpc_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateSystemRouterId","name":"system_router_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV4RouteId","name":"default_v4_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultV6RouteId","name":"default_v6_route_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultSubnetId","name":"default_subnet_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateDefaultInternetGatewayId","name":"default_internet_gateway_id"}},{"Action":{"action_name":"vpc_create.vpc_create_vpc","label":"VpcCreateVpc","name":"vpc"}},{"Action":{"action_name":"vpc_create.vpc_create_router","label":"VpcCreateRouter","name":"router"}},{"Action":{"action_name":"vpc_create.vpc_create_v4_route","label":"VpcCreateV4Route","name":"route4"}},{"Action":{"action_name":"vpc_create.vpc_create_v6_route","label":"VpcCreateV6Route","name":"route6"}},{"Action":{"action_name":"vpc_create.vpc_create_subnet","label":"VpcCreateSubnet","name":"subnet"}},{"Action":{"action_name":"vpc_create.vpc_update_firewall","label":"VpcUpdateFirewall","name":"firewall"}},{"Action":{"action_name":"vpc_create.vpc_create_gateway","label":"VpcCreateGateway","name":"gateway"}},{"Action":{"action_name":"vpc_create.vpc_notify_sleds","label":"VpcNotifySleds","name":"no_result"}},{"SubsagaEnd":{"name":"vpc"}},{"Start":{"params":{"authz_silo":{"key":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","lookup_type":{"ById":"207f2d86-9d5c-4ed8-9fa3-55f780829af6"},"parent":null},"project_create":{"description":"","name":"proj-daa0caca2e6"},"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","silo_user_id":"30bf7104-150f-4663-90ba-fce3d41eca1d"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"project-create","start_node":18} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28352024-12-12T22:34:41.475ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create
28362024-12-12T22:34:41.509ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create
28372024-12-12T22:34:41.509ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28382024-12-12T22:34:41.509ZDEBGnexus (SEC): saga log event new_state = N018 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28392024-12-12T22:34:41.509ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 18 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28402024-12-12T22:34:41.514ZDEBGnexus (SEC): saga log event new_state = N018 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28412024-12-12T22:34:41.514ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 18 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28422024-12-12T22:34:41.519ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28432024-12-12T22:34:41.519ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28442024-12-12T22:34:41.532ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28452024-12-12T22:34:41.532ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28462024-12-12T22:34:41.535ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28472024-12-12T22:34:41.535ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28482024-12-12T22:34:41.537ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28492024-12-12T22:34:41.537ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28502024-12-12T22:34:41.540ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28512024-12-12T22:34:41.541ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28522024-12-12T22:34:41.541ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28532024-12-12T22:34:41.541ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = ProjectCreateRecord
28542024-12-12T22:34:41.553ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28552024-12-12T22:34:41.553ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "name": String("proj-daa0caca2e6"), "time_created": String("2024-12-12T22:34:41.532021Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.532021Z")}, "rcgen": Number(1), "silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}]) node_id = 0 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28562024-12-12T22:34:41.556ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28572024-12-12T22:34:41.556ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28582024-12-12T22:34:41.561ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28592024-12-12T22:34:41.561ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"authz_project": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdae:2c9:922::/48"), "name": String("default")}}) node_id = 1 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28602024-12-12T22:34:41.567ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28612024-12-12T22:34:41.567ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28622024-12-12T22:34:41.570ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28632024-12-12T22:34:41.570ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 2 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28642024-12-12T22:34:41.574ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28652024-12-12T22:34:41.574ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28662024-12-12T22:34:41.577ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28672024-12-12T22:34:41.577ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")) node_id = 3 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28682024-12-12T22:34:41.586ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28692024-12-12T22:34:41.586ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28702024-12-12T22:34:41.590ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28712024-12-12T22:34:41.590ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e250e972-4522-42a0-ace7-ea7578467ea4")) node_id = 4 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28722024-12-12T22:34:41.595ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28732024-12-12T22:34:41.595ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28742024-12-12T22:34:41.599ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28752024-12-12T22:34:41.599ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("e98bd7a2-47c9-4078-9fc0-77048e01d6ca")) node_id = 5 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28762024-12-12T22:34:41.602ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28772024-12-12T22:34:41.602ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28782024-12-12T22:34:41.607ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28792024-12-12T22:34:41.607ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("6587156e-548d-49bd-810d-1c15218fad80")) node_id = 6 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28802024-12-12T22:34:41.611ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28812024-12-12T22:34:41.611ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28822024-12-12T22:34:41.615ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28832024-12-12T22:34:41.615ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("0a313138-68e2-40cd-a51d-6bd10274df54")) node_id = 7 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28842024-12-12T22:34:41.619ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28852024-12-12T22:34:41.619ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28862024-12-12T22:34:41.623ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28872024-12-12T22:34:41.623ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91")) node_id = 8 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28882024-12-12T22:34:41.627ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
28892024-12-12T22:34:41.627ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
28902024-12-12T22:34:41.632ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28912024-12-12T22:34:41.632ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28922024-12-12T22:34:41.634ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28932024-12-12T22:34:41.635ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28942024-12-12T22:34:41.637ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28952024-12-12T22:34:41.637ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28962024-12-12T22:34:41.639ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28972024-12-12T22:34:41.639ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28982024-12-12T22:34:41.642ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
28992024-12-12T22:34:41.644ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
29002024-12-12T22:34:41.644ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
29012024-12-12T22:34:41.644ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateVpc
29022024-12-12T22:34:41.657ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29032024-12-12T22:34:41.657ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "name": String("default"), "time_created": String("2024-12-12T22:34:41.631980Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.631980Z")}, "ipv6_prefix": String("fdae:2c9:922::/48"), "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "subnet_gen": Number(1), "system_router_id": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "vni": Number(7387540)}]) node_id = 9 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29042024-12-12T22:34:41.661ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29052024-12-12T22:34:41.661ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29062024-12-12T22:34:41.665ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29072024-12-12T22:34:41.665ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29082024-12-12T22:34:41.667ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29092024-12-12T22:34:41.667ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29102024-12-12T22:34:41.669ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29112024-12-12T22:34:41.670ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29122024-12-12T22:34:41.672ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29132024-12-12T22:34:41.672ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29142024-12-12T22:34:41.674ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29152024-12-12T22:34:41.677ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29162024-12-12T22:34:41.677ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29172024-12-12T22:34:41.677ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateRouter
29182024-12-12T22:34:41.709ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29192024-12-12T22:34:41.709ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "lookup_type": Object {"ById": String("e250e972-4522-42a0-ace7-ea7578467ea4")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}) node_id = 10 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29202024-12-12T22:34:41.712ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29212024-12-12T22:34:41.712ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29222024-12-12T22:34:41.716ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29232024-12-12T22:34:41.716ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29242024-12-12T22:34:41.718ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29252024-12-12T22:34:41.718ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29262024-12-12T22:34:41.725ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29272024-12-12T22:34:41.725ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29282024-12-12T22:34:41.728ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29292024-12-12T22:34:41.728ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29302024-12-12T22:34:41.730ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29312024-12-12T22:34:41.734ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: e250e972-4522-42a0-ace7-ea7578467ea4, lookup_type: ById(e250e972-4522-42a0-ace7-ea7578467ea4) } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29322024-12-12T22:34:41.734ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29332024-12-12T22:34:41.734ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV4Route
29342024-12-12T22:34:41.741ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29352024-12-12T22:34:41.741ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 11 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29362024-12-12T22:34:41.745ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29372024-12-12T22:34:41.745ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29382024-12-12T22:34:41.750ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29392024-12-12T22:34:41.750ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29402024-12-12T22:34:41.752ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29412024-12-12T22:34:41.752ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29422024-12-12T22:34:41.754ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29432024-12-12T22:34:41.754ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29442024-12-12T22:34:41.757ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29452024-12-12T22:34:41.757ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29462024-12-12T22:34:41.759ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29472024-12-12T22:34:41.763ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: e250e972-4522-42a0-ace7-ea7578467ea4, lookup_type: ById(e250e972-4522-42a0-ace7-ea7578467ea4) } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29482024-12-12T22:34:41.763ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29492024-12-12T22:34:41.763ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateV6Route
29502024-12-12T22:34:41.802ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29512024-12-12T22:34:41.802ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 12 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29522024-12-12T22:34:41.807ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29532024-12-12T22:34:41.807ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29542024-12-12T22:34:41.810ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29552024-12-12T22:34:41.810ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29562024-12-12T22:34:41.812ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29572024-12-12T22:34:41.813ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29582024-12-12T22:34:41.815ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29592024-12-12T22:34:41.815ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29602024-12-12T22:34:41.817ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29612024-12-12T22:34:41.818ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29622024-12-12T22:34:41.820ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29632024-12-12T22:34:41.823ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29642024-12-12T22:34:41.829ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29652024-12-12T22:34:41.830ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29662024-12-12T22:34:41.844ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29672024-12-12T22:34:41.844ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateSubnet
29682024-12-12T22:34:41.849ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29692024-12-12T22:34:41.849ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"key": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "lookup_type": Object {"ById": String("0a313138-68e2-40cd-a51d-6bd10274df54")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "name": String("default"), "time_created": String("2024-12-12T22:34:41.810154Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.810154Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdae:2c9:922::/64"), "rcgen": Number(1), "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}]) node_id = 13 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29702024-12-12T22:34:41.854ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29712024-12-12T22:34:41.854ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29722024-12-12T22:34:41.857ZDEBGnexus: default firewall rules for vpc default rules = [VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: ef07a142-f289-493a-9b61-02d855631181, name: Name(Name("allow-internal-inbound")), description: "allow inbound traffic to all instances within the VPC if originated within the VPC", time_created: 2024-12-12T22:34:41.857313470Z, time_modified: 2024-12-12T22:34:41.857313470Z, time_deleted: None }, vpc_id: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: Some([VpcFirewallRuleHostFilter(Vpc(Name("default")))]), filter_ports: None, filter_protocols: None, action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: efa0c779-8200-4133-a4cf-4498d1cd8b13, name: Name(Name("allow-ssh")), description: "allow inbound TCP connections on port 22 from anywhere", time_created: 2024-12-12T22:34:41.857316200Z, time_modified: 2024-12-12T22:34:41.857316200Z, time_deleted: None }, vpc_id: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: Some([L4PortRange(L4PortRange { first: L4Port(22), last: L4Port(22) })]), filter_protocols: Some([VpcFirewallRuleProtocol(Tcp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }, VpcFirewallRule { identity: VpcFirewallRuleIdentity { id: 9c7fd776-3703-4c9c-ab59-2fed4e2a125a, name: Name(Name("allow-icmp")), description: "allow inbound ICMP traffic from anywhere", time_created: 2024-12-12T22:34:41.857317200Z, time_modified: 2024-12-12T22:34:41.857317200Z, time_deleted: None }, vpc_id: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, status: VpcFirewallRuleStatus(Enabled), direction: VpcFirewallRuleDirection(Inbound), targets: [VpcFirewallRuleTarget(Vpc(Name("default")))], filter_hosts: None, filter_ports: None, filter_protocols: Some([VpcFirewallRuleProtocol(Icmp)]), action: VpcFirewallRuleAction(Allow), priority: VpcFirewallRulePriority(VpcFirewallRulePriority(65534)) }]
29732024-12-12T22:34:41.857ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29742024-12-12T22:34:41.857ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29752024-12-12T22:34:41.859ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29762024-12-12T22:34:41.859ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29772024-12-12T22:34:41.861ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29782024-12-12T22:34:41.862ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29792024-12-12T22:34:41.864ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29802024-12-12T22:34:41.864ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29812024-12-12T22:34:41.867ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29822024-12-12T22:34:41.870ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29832024-12-12T22:34:41.870ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29842024-12-12T22:34:41.870ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcUpdateFirewall
29852024-12-12T22:34:41.928ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29862024-12-12T22:34:41.928ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ef07a142-f289-493a-9b61-02d855631181"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-12T22:34:41.857313470Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857313470Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("efa0c779-8200-4133-a4cf-4498d1cd8b13"), "name": String("allow-ssh"), "time_created": String("2024-12-12T22:34:41.857316200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857316200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9c7fd776-3703-4c9c-ab59-2fed4e2a125a"), "name": String("allow-icmp"), "time_created": String("2024-12-12T22:34:41.857317200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857317200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}]) node_id = 14 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29872024-12-12T22:34:41.932ZDEBGnexus (SEC): saga log event new_state = N015 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
29882024-12-12T22:34:41.932ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 15 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
29892024-12-12T22:34:41.936ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29902024-12-12T22:34:41.936ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29912024-12-12T22:34:41.938ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29922024-12-12T22:34:41.938ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29932024-12-12T22:34:41.941ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29942024-12-12T22:34:41.941ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29952024-12-12T22:34:41.944ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29962024-12-12T22:34:41.944ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29972024-12-12T22:34:41.946ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29982024-12-12T22:34:41.948ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
29992024-12-12T22:34:41.948ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30002024-12-12T22:34:41.949ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30012024-12-12T22:34:41.954ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30022024-12-12T22:34:41.954ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30032024-12-12T22:34:41.958ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30042024-12-12T22:34:41.958ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30052024-12-12T22:34:41.962ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30062024-12-12T22:34:41.962ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30072024-12-12T22:34:41.964ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30082024-12-12T22:34:41.964ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30092024-12-12T22:34:41.966ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30102024-12-12T22:34:41.966ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30112024-12-12T22:34:41.969ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30122024-12-12T22:34:41.969ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30132024-12-12T22:34:41.971ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30142024-12-12T22:34:41.974ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91, lookup_type: ById(ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91) } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30152024-12-12T22:34:41.974ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30162024-12-12T22:34:41.975ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcCreateGateway
30172024-12-12T22:34:41.983ZDEBGnexus (SEC): saga log event new_state = N015 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30182024-12-12T22:34:41.983ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"key": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91"), "lookup_type": Object {"ById": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}) node_id = 15 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30192024-12-12T22:34:41.988ZDEBGnexus (SEC): saga log event new_state = N016 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30202024-12-12T22:34:41.988ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 16 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30212024-12-12T22:34:41.991ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30222024-12-12T22:34:41.991ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30232024-12-12T22:34:41.993ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30242024-12-12T22:34:41.993ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30252024-12-12T22:34:41.995ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30262024-12-12T22:34:41.995ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30272024-12-12T22:34:41.996ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30282024-12-12T22:34:41.997ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30292024-12-12T22:34:41.999ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30302024-12-12T22:34:41.999ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30312024-12-12T22:34:42.001ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30322024-12-12T22:34:42.001ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30332024-12-12T22:34:42.003ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30342024-12-12T22:34:42.004ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30352024-12-12T22:34:42.006ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30362024-12-12T22:34:42.009ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30372024-12-12T22:34:42.009ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30382024-12-12T22:34:42.009ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30392024-12-12T22:34:42.012ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30402024-12-12T22:34:42.012ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30412024-12-12T22:34:42.014ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30422024-12-12T22:34:42.015ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30432024-12-12T22:34:42.017ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30442024-12-12T22:34:42.017ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30452024-12-12T22:34:42.020ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30462024-12-12T22:34:42.023ZDEBGnexus (SagaExecutor): authorize result action = ListChildren actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30472024-12-12T22:34:42.023ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30482024-12-12T22:34:42.023ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_node = VpcNotifySleds
30492024-12-12T22:34:42.028ZDEBGnexus: resolved names for firewall rules instance_interfaces = {} subnet_interfaces = {} subnet_networks = {} vpc_interfaces = {}
30502024-12-12T22:34:42.028ZDEBGnexus: resolved firewall rules for sled agents sled_agent_rules = []
30512024-12-12T22:34:42.028ZDEBGnexus: resolved 0 rules for sleds
30522024-12-12T22:34:42.049ZDEBGnexus: resolved sleds for vpc default vpc_to_sled = []
30532024-12-12T22:34:42.049ZDEBGnexus: sending firewall rules to sled agents
30542024-12-12T22:34:42.049ZINFOnexus: updated firewall rules on 0 sleds file = nexus/networking/src/firewall_rules.rs:496
30552024-12-12T22:34:42.049ZDEBGnexus (SEC): saga log event new_state = N016 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30562024-12-12T22:34:42.049ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 16 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30572024-12-12T22:34:42.053ZDEBGnexus (SEC): saga log event new_state = N017 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30582024-12-12T22:34:42.053ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 17 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30592024-12-12T22:34:42.057ZDEBGnexus (SEC): saga log event new_state = N017 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30602024-12-12T22:34:42.057ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 17 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30612024-12-12T22:34:42.061ZDEBGnexus (SEC): saga log event new_state = N019 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30622024-12-12T22:34:42.061ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 19 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30632024-12-12T22:34:42.066ZDEBGnexus (SEC): saga log event new_state = N019 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30642024-12-12T22:34:42.066ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 19 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30652024-12-12T22:34:42.070ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = 7115a405-035b-4f4e-a521-2f919358b720 sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30662024-12-12T22:34:42.070ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = 7115a405-035b-4f4e-a521-2f919358b720
30672024-12-12T22:34:42.113ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
30682024-12-12T22:34:42.114ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = 7115a405-035b-4f4e-a521-2f919358b720 saga_name = project-create saga_result = SagaResult { saga_id: 7115a405-035b-4f4e-a521-2f919358b720, saga_log: SagaLog { saga_id: 7115a405-035b-4f4e-a521-2f919358b720, unwinding: false, events: [N018 started, N018 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N013 started, N013 succeeded, N014 started, N014 succeeded, N015 started, N015 succeeded, N016 started, N016 succeeded, N017 started, N017 succeeded, N019 started, N019 succeeded], node_status: {0: Succeeded(Array [Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "name": String("proj-daa0caca2e6"), "time_created": String("2024-12-12T22:34:41.532021Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.532021Z")}, "rcgen": Number(1), "silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}]), 1: Succeeded(Object {"authz_project": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdae:2c9:922::/48"), "name": String("default")}}), 2: Succeeded(Null), 3: Succeeded(String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")), 4: Succeeded(String("e250e972-4522-42a0-ace7-ea7578467ea4")), 5: Succeeded(String("e98bd7a2-47c9-4078-9fc0-77048e01d6ca")), 6: Succeeded(String("6587156e-548d-49bd-810d-1c15218fad80")), 7: Succeeded(String("0a313138-68e2-40cd-a51d-6bd10274df54")), 8: Succeeded(String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91")), 9: Succeeded(Array [Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}, Object {"dns_name": String("default"), "firewall_gen": Number(1), "identity": Object {"description": String("Default VPC"), "id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "name": String("default"), "time_created": String("2024-12-12T22:34:41.631980Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.631980Z")}, "ipv6_prefix": String("fdae:2c9:922::/48"), "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "subnet_gen": Number(1), "system_router_id": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "vni": Number(7387540)}]), 10: Succeeded(Object {"key": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "lookup_type": Object {"ById": String("e250e972-4522-42a0-ace7-ea7578467ea4")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}), 11: Succeeded(Null), 12: Succeeded(Null), 13: Succeeded(Array [Object {"key": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "lookup_type": Object {"ById": String("0a313138-68e2-40cd-a51d-6bd10274df54")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "name": String("default"), "time_created": String("2024-12-12T22:34:41.810154Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.810154Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdae:2c9:922::/64"), "rcgen": Number(1), "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}]), 14: Succeeded(Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ef07a142-f289-493a-9b61-02d855631181"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-12T22:34:41.857313470Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857313470Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("efa0c779-8200-4133-a4cf-4498d1cd8b13"), "name": String("allow-ssh"), "time_created": String("2024-12-12T22:34:41.857316200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857316200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9c7fd776-3703-4c9c-ab59-2fed4e2a125a"), "name": String("allow-icmp"), "time_created": String("2024-12-12T22:34:41.857317200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857317200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}]), 15: Succeeded(Object {"key": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91"), "lookup_type": Object {"ById": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}), 16: Succeeded(Null), 17: Succeeded(Null), 18: Succeeded(Null), 19: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"default_internet_gateway_id": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91"), "default_subnet_id": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "default_v4_route_id": String("e98bd7a2-47c9-4078-9fc0-77048e01d6ca"), "default_v6_route_id": String("6587156e-548d-49bd-810d-1c15218fad80"), "firewall": Array [Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Array [Object {"type": String("vpc"), "value": String("default")}], "filter_ports": Null, "filter_protocols": Null, "identity": Object {"description": String("allow inbound traffic to all instances within the VPC if originated within the VPC"), "id": String("ef07a142-f289-493a-9b61-02d855631181"), "name": String("allow-internal-inbound"), "time_created": String("2024-12-12T22:34:41.857313470Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857313470Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Array [String("22")], "filter_protocols": Array [String("TCP")], "identity": Object {"description": String("allow inbound TCP connections on port 22 from anywhere"), "id": String("efa0c779-8200-4133-a4cf-4498d1cd8b13"), "name": String("allow-ssh"), "time_created": String("2024-12-12T22:34:41.857316200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857316200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}, Object {"action": String("allow"), "direction": String("inbound"), "filter_hosts": Null, "filter_ports": Null, "filter_protocols": Array [String("ICMP")], "identity": Object {"description": String("allow inbound ICMP traffic from anywhere"), "id": String("9c7fd776-3703-4c9c-ab59-2fed4e2a125a"), "name": String("allow-icmp"), "time_created": String("2024-12-12T22:34:41.857317200Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.857317200Z")}, "priority": Number(65534), "status": String("enabled"), "targets": Array [Object {"type": String("vpc"), "value": String("default")}], "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}], "gateway": Object {"key": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91"), "lookup_type": Object {"ById": String("ee0ec52b-1420-4c5e-b1cf-d5f3d6d27a91")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}, "no_result": Null, "project": Array [Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, Object {"identity": Object {"description": String(""), "id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "name": String("proj-daa0caca2e6"), "time_created": String("2024-12-12T22:34:41.532021Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.532021Z")}, "rcgen": Number(1), "silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}], "route4": Null, "route6": Null, "router": Object {"key": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "lookup_type": Object {"ById": String("e250e972-4522-42a0-ace7-ea7578467ea4")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}, "subnet": Array [Object {"key": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "lookup_type": Object {"ById": String("0a313138-68e2-40cd-a51d-6bd10274df54")}, "parent": Object {"key": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e"), "lookup_type": Object {"ByName": String("default")}, "parent": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}}}, Object {"custom_router_id": Null, "identity": Object {"description": String("The default subnet for default"), "id": String("0a313138-68e2-40cd-a51d-6bd10274df54"), "name": String("default"), "time_created": String("2024-12-12T22:34:41.810154Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:41.810154Z")}, "ipv4_block": String("172.30.0.0/22"), "ipv6_block": String("fdae:2c9:922::/64"), "rcgen": Number(1), "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")}], "system_router_id": String("e250e972-4522-42a0-ace7-ea7578467ea4"), "vpc": Null, "vpc_create_params": Object {"authz_project": Object {"key": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "lookup_type": Object {"ByName": String("proj-daa0caca2e6")}, "parent": Object {"key": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "lookup_type": Object {"ById": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6")}, "parent": Null}}, "serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "vpc_create": Object {"description": String("Default VPC"), "dns_name": String("default"), "ipv6_prefix": String("fdae:2c9:922::/48"), "name": String("default")}}, "vpc_id": String("e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e")} }) }
30692024-12-12T22:34:42.114ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 682146 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = a23e9305-3958-487c-97b2-8c76b09c17e6 response_code = 201 uri = /v1/projects
30702024-12-12T22:34:42.116ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30712024-12-12T22:34:42.116ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30722024-12-12T22:34:42.118ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30732024-12-12T22:34:42.118ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30742024-12-12T22:34:42.119ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30752024-12-12T22:34:42.121ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
30762024-12-12T22:34:42.121ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30772024-12-12T22:34:42.121ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30782024-12-12T22:34:42.123ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30792024-12-12T22:34:42.123ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30802024-12-12T22:34:42.124ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30812024-12-12T22:34:42.124ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30822024-12-12T22:34:42.125ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30832024-12-12T22:34:42.125ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30842024-12-12T22:34:42.127ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30852024-12-12T22:34:42.128ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
30862024-12-12T22:34:42.128ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30872024-12-12T22:34:42.128ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30882024-12-12T22:34:42.130ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
30892024-12-12T22:34:42.131ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
30902024-12-12T22:34:42.131ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30912024-12-12T22:34:42.131ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30922024-12-12T22:34:42.137ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30932024-12-12T22:34:42.137ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30942024-12-12T22:34:42.138ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30952024-12-12T22:34:42.138ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30962024-12-12T22:34:42.139ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30972024-12-12T22:34:42.140ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
30982024-12-12T22:34:42.141ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
30992024-12-12T22:34:42.141ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31002024-12-12T22:34:42.142ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31012024-12-12T22:34:42.144ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
31022024-12-12T22:34:42.144ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31032024-12-12T22:34:42.144ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31042024-12-12T22:34:42.145ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31052024-12-12T22:34:42.146ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31062024-12-12T22:34:42.147ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
31072024-12-12T22:34:42.147ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
31082024-12-12T22:34:42.148ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
31092024-12-12T22:34:42.149ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
31102024-12-12T22:34:42.149ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31112024-12-12T22:34:42.149ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31122024-12-12T22:34:42.151ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31132024-12-12T22:34:42.151ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31142024-12-12T22:34:42.153ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31152024-12-12T22:34:42.153ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31162024-12-12T22:34:42.156ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31172024-12-12T22:34:42.156ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31182024-12-12T22:34:42.158ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31192024-12-12T22:34:42.159ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31202024-12-12T22:34:42.161ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {} } uri = /v1/disks?project=proj-daa0caca2e6
31212024-12-12T22:34:42.161ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Database result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31222024-12-12T22:34:42.163ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/disks?project=proj-daa0caca2e6
31232024-12-12T22:34:42.166ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") } result = Ok(()) uri = /v1/disks?project=proj-daa0caca2e6
31242024-12-12T22:34:42.166ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31252024-12-12T22:34:42.166ZINFOnexus (SEC): saga create dag = {"end_node":10,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[3,4,null],[4,5,null],[5,6,null],[6,7,null],[7,8,null],[9,0,null],[8,10,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"common.uuid_generate","label":"GenerateDiskId","name":"disk_id"}},{"Action":{"action_name":"common.uuid_generate","label":"GenerateVolumeId","name":"volume_id"}},{"Action":{"action_name":"disk_create.create_disk_record","label":"CreateDiskRecord","name":"created_disk"}},{"Action":{"action_name":"disk_create.regions_alloc","label":"RegionsAlloc","name":"datasets_and_regions"}},{"Action":{"action_name":"disk_create.space_account","label":"SpaceAccount","name":"no_result"}},{"Action":{"action_name":"disk_create.regions_ensure_undo","label":"RegionsEnsureUndo","name":"regions_ensure_undo"}},{"Action":{"action_name":"disk_create.regions_ensure","label":"RegionsEnsure","name":"regions_ensure"}},{"Action":{"action_name":"disk_create.create_volume_record","label":"CreateVolumeRecord","name":"created_volume"}},{"Action":{"action_name":"disk_create.finalize_disk_record","label":"FinalizeDiskRecord","name":"disk_runtime"}},{"Start":{"params":{"create_params":{"description":"","disk_source":{"block_size":512,"type":"blank"},"name":"disk-95256c4e88d","size":1073741824},"project_id":"23efd212-aa36-483b-8e8a-e40ef2ca6fc1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","silo_user_id":"30bf7104-150f-4663-90ba-fce3d41eca1d"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}}}}},"End"]},"saga_name":"disk-create","start_node":9} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31262024-12-12T22:34:42.166ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31272024-12-12T22:34:42.170ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31282024-12-12T22:34:42.170ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31292024-12-12T22:34:42.170ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31302024-12-12T22:34:42.170ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31312024-12-12T22:34:42.174ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31322024-12-12T22:34:42.174ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 9 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31332024-12-12T22:34:42.177ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31342024-12-12T22:34:42.177ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31352024-12-12T22:34:42.180ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31362024-12-12T22:34:42.180ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("c71b5f39-38a7-4ff6-9096-14311c268ebd")) node_id = 0 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31372024-12-12T22:34:42.183ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31382024-12-12T22:34:42.183ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31392024-12-12T22:34:42.187ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31402024-12-12T22:34:42.187ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("0c476779-c880-45cf-9f01-3935e2f12bdf")) node_id = 1 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31412024-12-12T22:34:42.191ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31422024-12-12T22:34:42.191ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31432024-12-12T22:34:42.195ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31442024-12-12T22:34:42.195ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31452024-12-12T22:34:42.196ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31462024-12-12T22:34:42.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31472024-12-12T22:34:42.198ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31482024-12-12T22:34:42.198ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31492024-12-12T22:34:42.200ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31502024-12-12T22:34:42.201ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31512024-12-12T22:34:42.203ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31522024-12-12T22:34:42.203ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31532024-12-12T22:34:42.205ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31542024-12-12T22:34:42.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31552024-12-12T22:34:42.207ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31562024-12-12T22:34:42.210ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) } result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31572024-12-12T22:34:42.210ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31582024-12-12T22:34:42.210ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31592024-12-12T22:34:42.212ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31602024-12-12T22:34:42.212ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31612024-12-12T22:34:42.215ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31622024-12-12T22:34:42.215ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31632024-12-12T22:34:42.217ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31642024-12-12T22:34:42.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31652024-12-12T22:34:42.219ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31662024-12-12T22:34:42.222ZDEBGnexus (SagaExecutor): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) } result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31672024-12-12T22:34:42.222ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31682024-12-12T22:34:42.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = CreateDiskRecord
31692024-12-12T22:34:42.262ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31702024-12-12T22:34:42.262ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-12T22:34:42.195057Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}) node_id = 2 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31712024-12-12T22:34:42.266ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31722024-12-12T22:34:42.266ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31732024-12-12T22:34:42.269ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = RegionsAlloc
31742024-12-12T22:34:42.270ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = RegionsAlloc
31752024-12-12T22:34:42.331ZINFOnexus (datastore): Allocated regions for volume datasets_and_regions = [(Dataset { identity: DatasetIdentity { id: 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset), time_created: 2024-12-12T22:34:37.342769Z, time_modified: 2024-12-12T22:34:37.342769Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 8ec50946-b029-4583-84f3-35d2ce5b9dff, ip: Some(fd00:1122:3344:101::1a), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: fce5083e-3c29-4461-bcb4-b4b73ceeba7b, time_created: 2024-12-12T22:34:42.296910Z, time_modified: 2024-12-12T22:34:42.296910Z }, dataset_id: 0478fe97-62f1-4999-bda3-7591a57ad7e7 (dataset), volume_id: 0c476779-c880-45cf-9f01-3935e2f12bdf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset), time_created: 2024-12-12T22:34:37.342772Z, time_modified: 2024-12-12T22:34:37.342772Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 8146c792-6a91-4f87-a5d5-73980d0b7ba5, ip: Some(fd00:1122:3344:101::16), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: a2305878-ac55-4959-a16b-25869678b69d, time_created: 2024-12-12T22:34:42.296910Z, time_modified: 2024-12-12T22:34:42.296910Z }, dataset_id: 8511980e-a6aa-4bca-96bd-6b7117455d1d (dataset), volume_id: 0c476779-c880-45cf-9f01-3935e2f12bdf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false }), (Dataset { identity: DatasetIdentity { id: 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset), time_created: 2024-12-12T22:34:37.342773Z, time_modified: 2024-12-12T22:34:37.342773Z }, time_deleted: None, rcgen: Generation(Generation(1)), pool_id: 3c596d62-0729-49f7-ab54-437e3babc937, ip: Some(fd00:1122:3344:101::17), port: Some(SqlU16(32345)), kind: Crucible, size_used: Some(1073741824), zone_name: None, quota: None, reservation: None, compression: None }, Region { identity: RegionIdentity { id: 88f141ca-cc1e-4592-8bdd-21bac9c7f477, time_created: 2024-12-12T22:34:42.296910Z, time_modified: 2024-12-12T22:34:42.296910Z }, dataset_id: 2d2b252f-c54a-4319-bfcc-a4832513310d (dataset), volume_id: 0c476779-c880-45cf-9f01-3935e2f12bdf, block_size: ByteCount(ByteCount(512)), blocks_per_extent: 131072, extent_count: 16, port: None, read_only: false, deleting: false })] file = nexus/db-queries/src/db/datastore/region.rs:282 maybe_snapshot_id = None volume_id = 0c476779-c880-45cf-9f01-3935e2f12bdf
31762024-12-12T22:34:42.331ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31772024-12-12T22:34:42.331ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "time_created": String("2024-12-12T22:34:37.342769Z"), "time_modified": String("2024-12-12T22:34:37.342769Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("8ec50946-b029-4583-84f3-35d2ce5b9dff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "time_created": String("2024-12-12T22:34:37.342772Z"), "time_modified": String("2024-12-12T22:34:37.342772Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("8146c792-6a91-4f87-a5d5-73980d0b7ba5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a2305878-ac55-4959-a16b-25869678b69d"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "time_created": String("2024-12-12T22:34:37.342773Z"), "time_modified": String("2024-12-12T22:34:37.342773Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("3c596d62-0729-49f7-ab54-437e3babc937"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}]]) node_id = 3 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31782024-12-12T22:34:42.335ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31792024-12-12T22:34:42.335ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31802024-12-12T22:34:42.338ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = SpaceAccount
31812024-12-12T22:34:42.338ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = SpaceAccount
31822024-12-12T22:34:42.358ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31832024-12-12T22:34:42.358ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 4 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31842024-12-12T22:34:42.363ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31852024-12-12T22:34:42.363ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31862024-12-12T22:34:42.369ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31872024-12-12T22:34:42.369ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31882024-12-12T22:34:42.373ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31892024-12-12T22:34:42.373ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31902024-12-12T22:34:42.408ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 260.334325ms dataset = 2d2b252f-c54a-4319-bfcc-a4832513310d file = nexus/src/app/crucible.rs:231 region = 88f141ca-cc1e-4592-8bdd-21bac9c7f477 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31912024-12-12T22:34:42.412ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 153.054253ms dataset = 8511980e-a6aa-4bca-96bd-6b7117455d1d file = nexus/src/app/crucible.rs:231 region = a2305878-ac55-4959-a16b-25869678b69d saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31922024-12-12T22:34:42.425ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 339.038352ms dataset = 0478fe97-62f1-4999-bda3-7591a57ad7e7 file = nexus/src/app/crucible.rs:231 region = fce5083e-3c29-4461-bcb4-b4b73ceeba7b saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31932024-12-12T22:34:42.573ZWARNnexus (SagaExecutor): Region requested, not yet created. Retrying in 586.395439ms dataset = 8511980e-a6aa-4bca-96bd-6b7117455d1d file = nexus/src/app/crucible.rs:231 region = a2305878-ac55-4959-a16b-25869678b69d saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create
31942024-12-12T22:34:43.171ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31952024-12-12T22:34:43.171ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"key\\":\\"hHhBaiIC8eJKt+3JEe/Z5o7nMZGxostTi/m7kb8AsVs=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}")) node_id = 6 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31962024-12-12T22:34:43.175ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31972024-12-12T22:34:43.175ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
31982024-12-12T22:34:43.186ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
31992024-12-12T22:34:43.186ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32002024-12-12T22:34:43.189ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32012024-12-12T22:34:43.189ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32022024-12-12T22:34:43.192ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32032024-12-12T22:34:43.192ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32042024-12-12T22:34:43.195ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32052024-12-12T22:34:43.195ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32062024-12-12T22:34:43.196ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32072024-12-12T22:34:43.197ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32082024-12-12T22:34:43.198ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32092024-12-12T22:34:43.198ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32102024-12-12T22:34:43.200ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32112024-12-12T22:34:43.201ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32122024-12-12T22:34:43.202ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32132024-12-12T22:34:43.202ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32142024-12-12T22:34:43.205ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32152024-12-12T22:34:43.205ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32162024-12-12T22:34:43.208ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32172024-12-12T22:34:43.210ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) }, key: c71b5f39-38a7-4ff6-9096-14311c268ebd, lookup_type: ById(c71b5f39-38a7-4ff6-9096-14311c268ebd) } result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32182024-12-12T22:34:43.210ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32192024-12-12T22:34:43.211ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32202024-12-12T22:34:43.213ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32212024-12-12T22:34:43.213ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32222024-12-12T22:34:43.215ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32232024-12-12T22:34:43.215ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32242024-12-12T22:34:43.217ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32252024-12-12T22:34:43.217ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32262024-12-12T22:34:43.219ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32272024-12-12T22:34:43.222ZDEBGnexus (SagaExecutor): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) }, key: c71b5f39-38a7-4ff6-9096-14311c268ebd, lookup_type: ById(c71b5f39-38a7-4ff6-9096-14311c268ebd) } result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32282024-12-12T22:34:43.222ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32292024-12-12T22:34:43.222ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_node = FinalizeDiskRecord
32302024-12-12T22:34:43.237ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32312024-12-12T22:34:43.237ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32322024-12-12T22:34:43.240ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32332024-12-12T22:34:43.240ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32342024-12-12T22:34:43.244ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32352024-12-12T22:34:43.244ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32362024-12-12T22:34:43.247ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32372024-12-12T22:34:43.247ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
32382024-12-12T22:34:43.292ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
32392024-12-12T22:34:43.293ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17 saga_name = disk-create saga_result = SagaResult { saga_id: cea51ca0-5a94-44f5-8523-30b1cf793f17, saga_log: SagaLog { saga_id: cea51ca0-5a94-44f5-8523-30b1cf793f17, unwinding: false, events: [N009 started, N009 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N005 succeeded, N006 started, N006 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N010 started, N010 succeeded], node_status: {0: Succeeded(String("c71b5f39-38a7-4ff6-9096-14311c268ebd")), 1: Succeeded(String("0c476779-c880-45cf-9f01-3935e2f12bdf")), 2: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-12T22:34:42.195057Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}), 3: Succeeded(Array [Array [Object {"compression": Null, "identity": Object {"id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "time_created": String("2024-12-12T22:34:37.342769Z"), "time_modified": String("2024-12-12T22:34:37.342769Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("8ec50946-b029-4583-84f3-35d2ce5b9dff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "time_created": String("2024-12-12T22:34:37.342772Z"), "time_modified": String("2024-12-12T22:34:37.342772Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("8146c792-6a91-4f87-a5d5-73980d0b7ba5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a2305878-ac55-4959-a16b-25869678b69d"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "time_created": String("2024-12-12T22:34:37.342773Z"), "time_modified": String("2024-12-12T22:34:37.342773Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("3c596d62-0729-49f7-ab54-437e3babc937"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}]]), 4: Succeeded(Null), 5: Succeeded(Null), 6: Succeeded(String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"key\\":\\"hHhBaiIC8eJKt+3JEe/Z5o7nMZGxostTi/m7kb8AsVs=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}")), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Null), 10: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Null, node_outputs: {"created_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("creating"), "gen": Number(1), "time_updated": String("2024-12-12T22:34:42.195057Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}, "created_volume": Null, "datasets_and_regions": Array [Array [Object {"compression": Null, "identity": Object {"id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "time_created": String("2024-12-12T22:34:37.342769Z"), "time_modified": String("2024-12-12T22:34:37.342769Z")}, "ip": String("fd00:1122:3344:101::1a"), "kind": String("Crucible"), "pool_id": String("8ec50946-b029-4583-84f3-35d2ce5b9dff"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("0478fe97-62f1-4999-bda3-7591a57ad7e7"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "time_created": String("2024-12-12T22:34:37.342772Z"), "time_modified": String("2024-12-12T22:34:37.342772Z")}, "ip": String("fd00:1122:3344:101::16"), "kind": String("Crucible"), "pool_id": String("8146c792-6a91-4f87-a5d5-73980d0b7ba5"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("8511980e-a6aa-4bca-96bd-6b7117455d1d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("a2305878-ac55-4959-a16b-25869678b69d"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}], Array [Object {"compression": Null, "identity": Object {"id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "time_created": String("2024-12-12T22:34:37.342773Z"), "time_modified": String("2024-12-12T22:34:37.342773Z")}, "ip": String("fd00:1122:3344:101::17"), "kind": String("Crucible"), "pool_id": String("3c596d62-0729-49f7-ab54-437e3babc937"), "port": Number(32345), "quota": Null, "rcgen": Number(1), "reservation": Null, "size_used": Number(1073741824), "time_deleted": Null, "zone_name": Null}, Object {"block_size": Number(512), "blocks_per_extent": Number(131072), "dataset_id": String("2d2b252f-c54a-4319-bfcc-a4832513310d"), "deleting": Bool(false), "extent_count": Number(16), "identity": Object {"id": String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), "time_created": String("2024-12-12T22:34:42.296910Z"), "time_modified": String("2024-12-12T22:34:42.296910Z")}, "port": Null, "read_only": Bool(false), "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}]], "disk_id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "disk_runtime": Null, "no_result": Null, "regions_ensure": String("{\\"type\\":\\"volume\\",\\"block_size\\":512,\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"sub_volumes\\":[{\\"type\\":\\"region\\",\\"block_size\\":512,\\"blocks_per_extent\\":131072,\\"extent_count\\":16,\\"gen\\":1,\\"opts\\":{\\"id\\":\\"c71b5f39-38a7-4ff6-9096-14311c268ebd\\",\\"key\\":\\"hHhBaiIC8eJKt+3JEe/Z5o7nMZGxostTi/m7kb8AsVs=\\",\\"lossy\\":false,\\"read_only\\":false,\\"target\\":[\\"[fd00:1122:3344:101::17]:19000\\",\\"[fd00:1122:3344:101::1a]:19000\\",\\"[fd00:1122:3344:101::16]:19000\\"]}}]}"), "regions_ensure_undo": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")} }) }
32402024-12-12T22:34:43.293ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1177633 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 534066c0-5130-4eeb-8ce2-6a51ec2a387d response_code = 201 uri = /v1/disks?project=proj-daa0caca2e6
32412024-12-12T22:34:43.295ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32422024-12-12T22:34:43.295ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32432024-12-12T22:34:43.297ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32442024-12-12T22:34:43.297ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32452024-12-12T22:34:43.299ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32462024-12-12T22:34:43.300ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
32472024-12-12T22:34:43.300ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32482024-12-12T22:34:43.300ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32492024-12-12T22:34:43.302ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32502024-12-12T22:34:43.302ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32512024-12-12T22:34:43.303ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32522024-12-12T22:34:43.303ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32532024-12-12T22:34:43.304ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32542024-12-12T22:34:43.304ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32552024-12-12T22:34:43.306ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32562024-12-12T22:34:43.307ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
32572024-12-12T22:34:43.307ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32582024-12-12T22:34:43.307ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32592024-12-12T22:34:43.308ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32602024-12-12T22:34:43.309ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
32612024-12-12T22:34:43.309ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32622024-12-12T22:34:43.310ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32632024-12-12T22:34:43.314ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32642024-12-12T22:34:43.314ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32652024-12-12T22:34:43.315ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32662024-12-12T22:34:43.316ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32672024-12-12T22:34:43.317ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32682024-12-12T22:34:43.317ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32692024-12-12T22:34:43.319ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32702024-12-12T22:34:43.319ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32712024-12-12T22:34:43.320ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32722024-12-12T22:34:43.321ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
32732024-12-12T22:34:43.321ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32742024-12-12T22:34:43.321ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32752024-12-12T22:34:43.323ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32762024-12-12T22:34:43.323ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32772024-12-12T22:34:43.324ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
32782024-12-12T22:34:43.324ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
32792024-12-12T22:34:43.326ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
32802024-12-12T22:34:43.327ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
32812024-12-12T22:34:43.327ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32822024-12-12T22:34:43.327ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32832024-12-12T22:34:43.328ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32842024-12-12T22:34:43.328ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32852024-12-12T22:34:43.330ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32862024-12-12T22:34:43.331ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32872024-12-12T22:34:43.334ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32882024-12-12T22:34:43.334ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32892024-12-12T22:34:43.335ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32902024-12-12T22:34:43.336ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32912024-12-12T22:34:43.338ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32922024-12-12T22:34:43.338ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32932024-12-12T22:34:43.340ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32942024-12-12T22:34:43.341ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32952024-12-12T22:34:43.343ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32962024-12-12T22:34:43.346ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: c71b5f39-38a7-4ff6-9096-14311c268ebd, lookup_type: ByName("disk-95256c4e88d") } result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32972024-12-12T22:34:43.346ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32982024-12-12T22:34:43.346ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
32992024-12-12T22:34:43.348ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33002024-12-12T22:34:43.348ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33012024-12-12T22:34:43.349ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33022024-12-12T22:34:43.349ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33032024-12-12T22:34:43.351ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33042024-12-12T22:34:43.351ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33052024-12-12T22:34:43.353ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33062024-12-12T22:34:43.353ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33072024-12-12T22:34:43.355ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33082024-12-12T22:34:43.355ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33092024-12-12T22:34:43.358ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33102024-12-12T22:34:43.358ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Database result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33112024-12-12T22:34:43.360ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33122024-12-12T22:34:43.363ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 resource = Disk { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ById(23efd212-aa36-483b-8e8a-e40ef2ca6fc1) }, key: c71b5f39-38a7-4ff6-9096-14311c268ebd, lookup_type: ById(c71b5f39-38a7-4ff6-9096-14311c268ebd) } result = Ok(()) uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33132024-12-12T22:34:43.363ZINFOnexus (SagaExecutor): preparing saga file = nexus/src/app/saga.rs:255 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33142024-12-12T22:34:43.363ZINFOnexus (SEC): saga create dag = {"end_node":14,"graph":{"edge_property":"directed","edges":[[0,1,null],[1,2,null],[2,3,null],[4,5,null],[4,6,null],[6,7,null],[5,7,null],[7,8,null],[8,9,null],[9,10,null],[10,11,null],[3,4,null],[11,12,null],[13,0,null],[12,14,null]],"node_holes":[],"nodes":[{"Action":{"action_name":"disk_delete.delete_disk_record","label":"DeleteDiskRecord","name":"deleted_disk"}},{"Action":{"action_name":"disk_delete.space_account","label":"SpaceAccount","name":"no_result1"}},{"Constant":{"name":"params_for_volume_delete_subsaga","value":{"serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","silo_user_id":"30bf7104-150f-4663-90ba-fce3d41eca1d"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"0c476779-c880-45cf-9f01-3935e2f12bdf"}}},{"SubsagaStart":{"params_node_name":"params_for_volume_delete_subsaga","saga_name":"volume-delete"}},{"Action":{"action_name":"volume_delete.decrease_crucible_resource_count","label":"DecreaseCrucibleResourceCount","name":"crucible_resources_to_delete"}},{"Action":{"action_name":"volume_delete.delete_crucible_regions","label":"DeleteCrucibleRegions","name":"no_result_1"}},{"Action":{"action_name":"volume_delete.delete_crucible_running_snapshots","label":"DeleteCrucibleRunningSnapshots","name":"no_result_2"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshots","label":"DeleteCrucibleSnapshots","name":"no_result_3"}},{"Action":{"action_name":"volume_delete.delete_crucible_snapshot_records","label":"DeleteCrucibleSnapshotRecords","name":"no_result_4"}},{"Action":{"action_name":"volume_delete.find_freed_crucible_regions","label":"FindFreedCrucibleRegions","name":"freed_crucible_regions"}},{"Action":{"action_name":"volume_delete.delete_freed_crucible_regions","label":"DeleteFreedCrucibleRegions","name":"no_result_5"}},{"Action":{"action_name":"volume_delete.hard_delete_volume_record","label":"HardDeleteVolumeRecord","name":"volume_hard_deleted"}},{"SubsagaEnd":{"name":"volume_delete_subsaga_no_result"}},{"Start":{"params":{"disk_id":"c71b5f39-38a7-4ff6-9096-14311c268ebd","project_id":"23efd212-aa36-483b-8e8a-e40ef2ca6fc1","serialized_authn":{"kind":{"Authenticated":[{"actor":{"SiloUser":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","silo_user_id":"30bf7104-150f-4663-90ba-fce3d41eca1d"}}},{"mapped_fleet_roles":{"admin":["admin"]}}]}},"volume_id":"0c476779-c880-45cf-9f01-3935e2f12bdf"}}},"End"]},"saga_name":"disk-delete","start_node":13} file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1146 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33152024-12-12T22:34:43.363ZINFOnexus (SecStore): creating saga file = nexus/db-queries/src/db/sec_store.rs:50 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33162024-12-12T22:34:43.368ZINFOnexus (SagaExecutor): starting saga file = nexus/src/app/saga.rs:353 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33172024-12-12T22:34:43.368ZINFOnexus (SEC): saga start file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:967 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33182024-12-12T22:34:43.368ZDEBGnexus (SEC): saga log event new_state = N013 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33192024-12-12T22:34:43.368ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 13 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33202024-12-12T22:34:43.374ZDEBGnexus (SEC): saga log event new_state = N013 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33212024-12-12T22:34:43.374ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 13 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33222024-12-12T22:34:43.377ZDEBGnexus (SEC): saga log event new_state = N000 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33232024-12-12T22:34:43.377ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 0 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33242024-12-12T22:34:43.392ZDEBGnexus (SEC): saga log event new_state = N000 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33252024-12-12T22:34:43.392ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-12T22:34:43.210857Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}) node_id = 0 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33262024-12-12T22:34:43.395ZDEBGnexus (SEC): saga log event new_state = N001 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33272024-12-12T22:34:43.395ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 1 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33282024-12-12T22:34:43.399ZDEBGnexus (SagaExecutor): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true roles = RoleSet { roles: {} } saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete saga_node = SpaceAccount
33292024-12-12T22:34:43.399ZDEBGnexus (SagaExecutor): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true resource = Database result = Ok(()) saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete saga_node = SpaceAccount
33302024-12-12T22:34:43.413ZDEBGnexus (SEC): saga log event new_state = N001 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33312024-12-12T22:34:43.413ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 1 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33322024-12-12T22:34:43.416ZDEBGnexus (SEC): saga log event new_state = N002 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33332024-12-12T22:34:43.416ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 2 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33342024-12-12T22:34:43.419ZDEBGnexus (SEC): saga log event new_state = N002 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33352024-12-12T22:34:43.419ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}) node_id = 2 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33362024-12-12T22:34:43.423ZDEBGnexus (SEC): saga log event new_state = N003 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33372024-12-12T22:34:43.423ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 3 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33382024-12-12T22:34:43.426ZDEBGnexus (SEC): saga log event new_state = N003 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33392024-12-12T22:34:43.426ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 3 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33402024-12-12T22:34:43.429ZDEBGnexus (SEC): saga log event new_state = N004 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33412024-12-12T22:34:43.429ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 4 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33422024-12-12T22:34:43.443ZDEBGnexus (SEC): saga log event new_state = N004 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33432024-12-12T22:34:43.443ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), String("a2305878-ac55-4959-a16b-25869678b69d")]}}) node_id = 4 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33442024-12-12T22:34:43.447ZDEBGnexus (SEC): saga log event new_state = N005 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33452024-12-12T22:34:43.447ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 5 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33462024-12-12T22:34:43.450ZDEBGnexus (SEC): saga log event new_state = N006 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33472024-12-12T22:34:43.450ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 6 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33482024-12-12T22:34:43.454ZDEBGnexus (SEC): saga log event new_state = N006 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33492024-12-12T22:34:43.454ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 6 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33502024-12-12T22:34:43.482ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 127.491509ms file = nexus/src/app/crucible.rs:828 region_id = fce5083e-3c29-4461-bcb4-b4b73ceeba7b saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33512024-12-12T22:34:43.484ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 126.390918ms file = nexus/src/app/crucible.rs:828 region_id = a2305878-ac55-4959-a16b-25869678b69d saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33522024-12-12T22:34:43.485ZINFOnexus (SagaExecutor): Transient(region not deleted yet), trying again in 119.011007ms file = nexus/src/app/crucible.rs:828 region_id = 88f141ca-cc1e-4592-8bdd-21bac9c7f477 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33532024-12-12T22:34:43.609ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = 88f141ca-cc1e-4592-8bdd-21bac9c7f477 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33542024-12-12T22:34:43.614ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = fce5083e-3c29-4461-bcb4-b4b73ceeba7b saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33552024-12-12T22:34:43.615ZINFOnexus (SagaExecutor): region deleted file = nexus/src/app/crucible.rs:813 region_id = a2305878-ac55-4959-a16b-25869678b69d saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33562024-12-12T22:34:43.635ZDEBGnexus (SEC): saga log event new_state = N005 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33572024-12-12T22:34:43.635ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 5 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33582024-12-12T22:34:43.639ZDEBGnexus (SEC): saga log event new_state = N007 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33592024-12-12T22:34:43.639ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 7 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33602024-12-12T22:34:43.643ZDEBGnexus (SEC): saga log event new_state = N007 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33612024-12-12T22:34:43.643ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 7 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33622024-12-12T22:34:43.647ZDEBGnexus (SEC): saga log event new_state = N008 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33632024-12-12T22:34:43.647ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 8 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33642024-12-12T22:34:43.651ZDEBGnexus (SEC): saga log event new_state = N008 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33652024-12-12T22:34:43.651ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 8 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33662024-12-12T22:34:43.654ZDEBGnexus (SEC): saga log event new_state = N009 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33672024-12-12T22:34:43.654ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 9 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33682024-12-12T22:34:43.663ZDEBGnexus (SEC): saga log event new_state = N009 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33692024-12-12T22:34:43.663ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Array []) node_id = 9 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33702024-12-12T22:34:43.666ZDEBGnexus (SEC): saga log event new_state = N010 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33712024-12-12T22:34:43.666ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 10 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33722024-12-12T22:34:43.669ZDEBGnexus (SEC): saga log event new_state = N010 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33732024-12-12T22:34:43.669ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 10 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33742024-12-12T22:34:43.672ZDEBGnexus (SEC): saga log event new_state = N011 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33752024-12-12T22:34:43.672ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 11 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33762024-12-12T22:34:43.678ZINFOnexus (SagaExecutor): allocated regions for 0c476779-c880-45cf-9f01-3935e2f12bdf is empty, calling volume_hard_delete file = nexus/src/app/sagas/volume_delete.rs:531 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete
33772024-12-12T22:34:43.682ZDEBGnexus (SEC): saga log event new_state = N011 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33782024-12-12T22:34:43.682ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 11 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33792024-12-12T22:34:43.685ZDEBGnexus (SEC): saga log event new_state = N012 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33802024-12-12T22:34:43.685ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 12 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33812024-12-12T22:34:43.688ZDEBGnexus (SEC): saga log event new_state = N012 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33822024-12-12T22:34:43.688ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Bool(true)) node_id = 12 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33832024-12-12T22:34:43.691ZDEBGnexus (SEC): saga log event new_state = N014 started sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33842024-12-12T22:34:43.691ZDEBGnexus (SecStore): recording saga event event_type = Started node_id = 14 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33852024-12-12T22:34:43.694ZDEBGnexus (SEC): saga log event new_state = N014 succeeded sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33862024-12-12T22:34:43.694ZDEBGnexus (SecStore): recording saga event event_type = Succeeded(Null) node_id = 14 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33872024-12-12T22:34:43.697ZINFOnexus (SEC): update for saga cached state file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1384 new_state = Done saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33882024-12-12T22:34:43.697ZINFOnexus (SecStore): updating state file = nexus/db-queries/src/db/sec_store.rs:95 new_state = done saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
33892024-12-12T22:34:43.702ZINFOnexus (SEC): saga finished file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/steno-0.4.1/src/sec.rs:1025 result = success saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete sec_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
33902024-12-12T22:34:43.702ZINFOnexus (SagaExecutor): saga finished file = nexus/src/app/saga.rs:404 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980 saga_name = disk-delete saga_result = SagaResult { saga_id: b7274254-9ab5-4831-aee0-d40919b9b980, saga_log: SagaLog { saga_id: b7274254-9ab5-4831-aee0-d40919b9b980, unwinding: false, events: [N013 started, N013 succeeded, N000 started, N000 succeeded, N001 started, N001 succeeded, N002 started, N002 succeeded, N003 started, N003 succeeded, N004 started, N004 succeeded, N005 started, N006 started, N006 succeeded, N005 succeeded, N007 started, N007 succeeded, N008 started, N008 succeeded, N009 started, N009 succeeded, N010 started, N010 succeeded, N011 started, N011 succeeded, N012 started, N012 succeeded, N014 started, N014 succeeded], node_status: {0: Succeeded(Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-12T22:34:43.210857Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}), 1: Succeeded(Null), 2: Succeeded(Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}), 3: Succeeded(Null), 4: Succeeded(Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), String("a2305878-ac55-4959-a16b-25869678b69d")]}}), 5: Succeeded(Null), 6: Succeeded(Null), 7: Succeeded(Null), 8: Succeeded(Null), 9: Succeeded(Array []), 10: Succeeded(Null), 11: Succeeded(Bool(true)), 12: Succeeded(Bool(true)), 13: Succeeded(Null), 14: Succeeded(Null)} }, kind: Ok(SagaResultOk { saga_output: Bool(true), node_outputs: {"crucible_resources_to_delete": Object {"V3": Object {"region_snapshots": Array [], "regions": Array [String("88f141ca-cc1e-4592-8bdd-21bac9c7f477"), String("fce5083e-3c29-4461-bcb4-b4b73ceeba7b"), String("a2305878-ac55-4959-a16b-25869678b69d")]}}, "deleted_disk": Object {"block_size": String("Traditional"), "create_image_id": Null, "create_snapshot_id": Null, "identity": Object {"description": String(""), "id": String("c71b5f39-38a7-4ff6-9096-14311c268ebd"), "name": String("disk-95256c4e88d"), "time_created": String("2024-12-12T22:34:42.195057Z"), "time_deleted": Null, "time_modified": String("2024-12-12T22:34:42.195057Z")}, "pantry_address": Null, "project_id": String("23efd212-aa36-483b-8e8a-e40ef2ca6fc1"), "rcgen": Number(1), "runtime_state": Object {"attach_instance_id": Null, "disk_state": String("detached"), "gen": Number(2), "time_updated": String("2024-12-12T22:34:43.210857Z")}, "size": Number(1073741824), "slot": Null, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}, "freed_crucible_regions": Array [], "no_result1": Null, "no_result_1": Null, "no_result_2": Null, "no_result_3": Null, "no_result_4": Null, "no_result_5": Null, "params_for_volume_delete_subsaga": Object {"serialized_authn": Object {"kind": Object {"Authenticated": Array [Object {"actor": Object {"SiloUser": Object {"silo_id": String("207f2d86-9d5c-4ed8-9fa3-55f780829af6"), "silo_user_id": String("30bf7104-150f-4663-90ba-fce3d41eca1d")}}}, Object {"mapped_fleet_roles": Object {"admin": Array [String("admin")]}}]}}, "volume_id": String("0c476779-c880-45cf-9f01-3935e2f12bdf")}, "volume_delete_subsaga_no_result": Bool(true), "volume_hard_deleted": Bool(true)} }) }
33912024-12-12T22:34:43.703ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 408531 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 584a6042-75a8-4045-8d21-b1bef7a8be20 response_code = 204 uri = /v1/disks/disk-95256c4e88d?project=proj-daa0caca2e6
33922024-12-12T22:34:43.704ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33932024-12-12T22:34:43.704ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33942024-12-12T22:34:43.706ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
33952024-12-12T22:34:43.708ZDEBGnexus (ExternalAuthn): authorize result action = CreateChild actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = DeviceAuthRequestList result = Ok(())
33962024-12-12T22:34:43.708ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
33972024-12-12T22:34:43.708ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
33982024-12-12T22:34:43.711ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 7869 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 54c9aa4a-0872-4e23-8d58-7e64d4ecbe70 response_code = 200 uri = /device/auth
33992024-12-12T22:34:43.713ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34002024-12-12T22:34:43.713ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34012024-12-12T22:34:43.714ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34022024-12-12T22:34:43.715ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34032024-12-12T22:34:43.716ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34042024-12-12T22:34:43.717ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
34052024-12-12T22:34:43.717ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34062024-12-12T22:34:43.717ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34072024-12-12T22:34:43.718ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34082024-12-12T22:34:43.719ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34092024-12-12T22:34:43.720ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34102024-12-12T22:34:43.720ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34112024-12-12T22:34:43.721ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34122024-12-12T22:34:43.721ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34132024-12-12T22:34:43.723ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34142024-12-12T22:34:43.724ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
34152024-12-12T22:34:43.724ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34162024-12-12T22:34:43.724ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34172024-12-12T22:34:43.725ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34182024-12-12T22:34:43.727ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
34192024-12-12T22:34:43.727ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34202024-12-12T22:34:43.727ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34212024-12-12T22:34:43.730ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34222024-12-12T22:34:43.730ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34232024-12-12T22:34:43.732ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34242024-12-12T22:34:43.732ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34252024-12-12T22:34:43.733ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34262024-12-12T22:34:43.733ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34272024-12-12T22:34:43.734ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34282024-12-12T22:34:43.734ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34292024-12-12T22:34:43.736ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34302024-12-12T22:34:43.737ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
34312024-12-12T22:34:43.737ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34322024-12-12T22:34:43.737ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34332024-12-12T22:34:43.739ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34342024-12-12T22:34:43.740ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34352024-12-12T22:34:43.742ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34362024-12-12T22:34:43.742ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34372024-12-12T22:34:43.743ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34382024-12-12T22:34:43.745ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
34392024-12-12T22:34:43.745ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34402024-12-12T22:34:43.745ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34412024-12-12T22:34:43.748ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34422024-12-12T22:34:43.748ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34432024-12-12T22:34:43.751ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34442024-12-12T22:34:43.751ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34452024-12-12T22:34:43.753ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /device/confirm
34462024-12-12T22:34:43.754ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = DeviceAuthRequest { parent: Fleet, key: "KKFB-BQRF", lookup_type: ByCompositeId("user_code = \\"KKFB-BQRF\\"") } result = Ok(()) uri = /device/confirm
34472024-12-12T22:34:43.754ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34482024-12-12T22:34:43.755ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34492024-12-12T22:34:43.756ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34502024-12-12T22:34:43.756ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34512024-12-12T22:34:43.758ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34522024-12-12T22:34:43.758ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34532024-12-12T22:34:43.760ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34542024-12-12T22:34:43.761ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34552024-12-12T22:34:43.763ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34562024-12-12T22:34:43.763ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34572024-12-12T22:34:43.765ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /device/confirm
34582024-12-12T22:34:43.766ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(()) uri = /device/confirm
34592024-12-12T22:34:43.766ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34602024-12-12T22:34:43.766ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34612024-12-12T22:34:43.769ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34622024-12-12T22:34:43.769ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34632024-12-12T22:34:43.771ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /device/confirm
34642024-12-12T22:34:43.772ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = DeviceAuthRequest { parent: Fleet, key: "KKFB-BQRF", lookup_type: ByCompositeId("user_code = \\"KKFB-BQRF\\"") } result = Ok(()) uri = /device/confirm
34652024-12-12T22:34:43.772ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34662024-12-12T22:34:43.772ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34672024-12-12T22:34:43.775ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34682024-12-12T22:34:43.775ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34692024-12-12T22:34:43.777ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34702024-12-12T22:34:43.778ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34712024-12-12T22:34:43.779ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /device/confirm
34722024-12-12T22:34:43.780ZDEBGnexus (dropshot_external): authorize result action = CreateChild actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(()) uri = /device/confirm
34732024-12-12T22:34:43.780ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 roles = RoleSet { roles: {} } uri = /device/confirm
34742024-12-12T22:34:43.780ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 resource = Database result = Ok(()) uri = /device/confirm
34752024-12-12T22:34:43.789ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 76063 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = ef340459-a9de-49bc-9f50-b7d43a932be4 response_code = 204 uri = /device/confirm
34762024-12-12T22:34:43.792ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34772024-12-12T22:34:43.792ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34782024-12-12T22:34:43.798ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6758 local_addr = 172.30.2.7:443 method = POST remote_addr = 10.151.2.100:42495 req_id = 97d9ebc4-12dd-4667-b5b9-419b8f16ab7f response_code = 200 uri = /device/token
34792024-12-12T22:34:43.800ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34802024-12-12T22:34:43.800ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34812024-12-12T22:34:43.801ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34822024-12-12T22:34:43.802ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34832024-12-12T22:34:43.803ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34842024-12-12T22:34:43.804ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
34852024-12-12T22:34:43.804ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34862024-12-12T22:34:43.804ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34872024-12-12T22:34:43.805ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34882024-12-12T22:34:43.806ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34892024-12-12T22:34:43.807ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34902024-12-12T22:34:43.807ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34912024-12-12T22:34:43.808ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34922024-12-12T22:34:43.809ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34932024-12-12T22:34:43.810ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34942024-12-12T22:34:43.811ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
34952024-12-12T22:34:43.811ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
34962024-12-12T22:34:43.812ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
34972024-12-12T22:34:43.813ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
34982024-12-12T22:34:43.814ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
34992024-12-12T22:34:43.814ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35002024-12-12T22:34:43.814ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35012024-12-12T22:34:43.818ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35022024-12-12T22:34:43.818ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35032024-12-12T22:34:43.819ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35042024-12-12T22:34:43.819ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35052024-12-12T22:34:43.820ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35062024-12-12T22:34:43.821ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35072024-12-12T22:34:43.822ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35082024-12-12T22:34:43.822ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35092024-12-12T22:34:43.823ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35102024-12-12T22:34:43.824ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
35112024-12-12T22:34:43.824ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35122024-12-12T22:34:43.825ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35132024-12-12T22:34:43.825ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35142024-12-12T22:34:43.826ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35152024-12-12T22:34:43.827ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35162024-12-12T22:34:43.827ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35172024-12-12T22:34:43.828ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35182024-12-12T22:34:43.829ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
35192024-12-12T22:34:43.830ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35202024-12-12T22:34:43.830ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35212024-12-12T22:34:43.831ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35222024-12-12T22:34:43.831ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35232024-12-12T22:34:43.833ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35242024-12-12T22:34:43.834ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35252024-12-12T22:34:43.835ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35262024-12-12T22:34:43.835ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35272024-12-12T22:34:43.837ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35282024-12-12T22:34:43.837ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35292024-12-12T22:34:43.843ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35302024-12-12T22:34:43.843ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35312024-12-12T22:34:43.845ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35322024-12-12T22:34:43.845ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35332024-12-12T22:34:43.848ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35342024-12-12T22:34:43.848ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35352024-12-12T22:34:43.850ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35362024-12-12T22:34:43.854ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: 0a313138-68e2-40cd-a51d-6bd10274df54, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35372024-12-12T22:34:43.854ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35382024-12-12T22:34:43.854ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35392024-12-12T22:34:43.856ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35402024-12-12T22:34:43.856ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35412024-12-12T22:34:43.859ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35422024-12-12T22:34:43.859ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35432024-12-12T22:34:43.861ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35442024-12-12T22:34:43.861ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35452024-12-12T22:34:43.864ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35462024-12-12T22:34:43.867ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: 0a313138-68e2-40cd-a51d-6bd10274df54, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35472024-12-12T22:34:43.867ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35482024-12-12T22:34:43.867ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35492024-12-12T22:34:43.869ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35502024-12-12T22:34:43.869ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35512024-12-12T22:34:43.874ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35522024-12-12T22:34:43.874ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35532024-12-12T22:34:43.884ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f roles = RoleSet { roles: {} } uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35542024-12-12T22:34:43.885ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f resource = Database result = Ok(()) uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35552024-12-12T22:34:43.889ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 88688 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = ca6fa4a3-cee8-41fe-b7c6-a6fee287993f response_code = 204 uri = /v1/vpc-subnets/default?project=proj-daa0caca2e6&vpc=default
35562024-12-12T22:34:43.889ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 2 reason = Signaled
35572024-12-12T22:34:43.889ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
35582024-12-12T22:34:43.889ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35592024-12-12T22:34:43.889ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35602024-12-12T22:34:43.890ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35612024-12-12T22:34:43.890ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35622024-12-12T22:34:43.890ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35632024-12-12T22:34:43.891ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35642024-12-12T22:34:43.891ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35652024-12-12T22:34:43.892ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35662024-12-12T22:34:43.892ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35672024-12-12T22:34:43.892ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35682024-12-12T22:34:43.893ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35692024-12-12T22:34:43.893ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
35702024-12-12T22:34:43.894ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
35712024-12-12T22:34:43.894ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35722024-12-12T22:34:43.894ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35732024-12-12T22:34:43.895ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
35742024-12-12T22:34:43.895ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35752024-12-12T22:34:43.895ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35762024-12-12T22:34:43.896ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35772024-12-12T22:34:43.896ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35782024-12-12T22:34:43.897ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35792024-12-12T22:34:43.897ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35802024-12-12T22:34:43.898ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35812024-12-12T22:34:43.898ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35822024-12-12T22:34:43.900ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35832024-12-12T22:34:43.901ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
35842024-12-12T22:34:43.901ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35852024-12-12T22:34:43.901ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35862024-12-12T22:34:43.902ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
35872024-12-12T22:34:43.903ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
35882024-12-12T22:34:43.903ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35892024-12-12T22:34:43.904ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35902024-12-12T22:34:43.928ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
35912024-12-12T22:34:43.929ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
35922024-12-12T22:34:43.929ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "05b83a5f-37b3-4608-86f1-f447d4f2a7af", "content-length": "312", "date": "Thu, 12 Dec 2024 22:34:43 GMT"} })
35932024-12-12T22:34:43.929ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
35942024-12-12T22:34:43.930ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
35952024-12-12T22:34:43.932ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35962024-12-12T22:34:43.933ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35972024-12-12T22:34:43.934ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
35982024-12-12T22:34:43.934ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
35992024-12-12T22:34:43.935ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36002024-12-12T22:34:43.935ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36012024-12-12T22:34:43.936ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36022024-12-12T22:34:43.937ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36032024-12-12T22:34:43.938ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36042024-12-12T22:34:43.939ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
36052024-12-12T22:34:43.939ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36062024-12-12T22:34:43.939ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36072024-12-12T22:34:43.940ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36082024-12-12T22:34:43.941ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36092024-12-12T22:34:43.942ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
36102024-12-12T22:34:43.942ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
36112024-12-12T22:34:43.943ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
36122024-12-12T22:34:43.944ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
36132024-12-12T22:34:43.944ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36142024-12-12T22:34:43.944ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36152024-12-12T22:34:43.946ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36162024-12-12T22:34:43.946ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36172024-12-12T22:34:43.948ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36182024-12-12T22:34:43.948ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36192024-12-12T22:34:43.950ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36202024-12-12T22:34:43.950ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36212024-12-12T22:34:43.951ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
36222024-12-12T22:34:43.951ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
36232024-12-12T22:34:43.952ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "396b2dff-56fb-4fc1-825e-bbef1b33b532", "date": "Thu, 12 Dec 2024 22:34:43 GMT"} })
36242024-12-12T22:34:43.952ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36252024-12-12T22:34:43.952ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36262024-12-12T22:34:43.952ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36272024-12-12T22:34:43.952ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36282024-12-12T22:34:43.954ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36292024-12-12T22:34:43.954ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36302024-12-12T22:34:43.955ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36312024-12-12T22:34:43.955ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36322024-12-12T22:34:43.957ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36332024-12-12T22:34:43.957ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36342024-12-12T22:34:43.958ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36352024-12-12T22:34:43.958ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36362024-12-12T22:34:43.959ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36372024-12-12T22:34:43.962ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36382024-12-12T22:34:43.962ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36392024-12-12T22:34:43.962ZDEBGnexus (dropshot_external): authorize result action = Read actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36402024-12-12T22:34:43.962ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36412024-12-12T22:34:43.962ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36422024-12-12T22:34:43.963ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36432024-12-12T22:34:43.963ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36442024-12-12T22:34:43.964ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36452024-12-12T22:34:43.965ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36462024-12-12T22:34:43.965ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36472024-12-12T22:34:43.965ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36482024-12-12T22:34:43.966ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36492024-12-12T22:34:43.966ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36502024-12-12T22:34:43.967ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36512024-12-12T22:34:43.967ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36522024-12-12T22:34:43.968ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36532024-12-12T22:34:43.968ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36542024-12-12T22:34:43.969ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36552024-12-12T22:34:43.969ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36562024-12-12T22:34:43.969ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36572024-12-12T22:34:43.969ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36582024-12-12T22:34:43.970ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36592024-12-12T22:34:43.971ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36602024-12-12T22:34:43.971ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36612024-12-12T22:34:43.972ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36622024-12-12T22:34:43.974ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36632024-12-12T22:34:43.974ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36642024-12-12T22:34:43.975ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36652024-12-12T22:34:43.976ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36662024-12-12T22:34:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36672024-12-12T22:34:43.976ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36682024-12-12T22:34:43.976ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36692024-12-12T22:34:43.976ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36702024-12-12T22:34:43.978ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36712024-12-12T22:34:43.978ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36722024-12-12T22:34:43.979ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36732024-12-12T22:34:43.979ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36742024-12-12T22:34:43.980ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36752024-12-12T22:34:43.980ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
36762024-12-12T22:34:43.980ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36772024-12-12T22:34:43.982ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36782024-12-12T22:34:43.982ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36792024-12-12T22:34:43.984ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000001, lookup_type: ById(001de000-074c-4000-8000-000000000001) } result = Ok(())
36802024-12-12T22:34:43.984ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36812024-12-12T22:34:43.984ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36822024-12-12T22:34:43.984ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36832024-12-12T22:34:43.984ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36842024-12-12T22:34:43.986ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36852024-12-12T22:34:43.986ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36862024-12-12T22:34:43.987ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36872024-12-12T22:34:43.987ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36882024-12-12T22:34:43.988ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36892024-12-12T22:34:43.989ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36902024-12-12T22:34:43.989ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36912024-12-12T22:34:43.990ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36922024-12-12T22:34:43.990ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36932024-12-12T22:34:43.991ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36942024-12-12T22:34:43.991ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
36952024-12-12T22:34:43.992ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = VpcRouter { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") }, key: e250e972-4522-42a0-ace7-ea7578467ea4, lookup_type: ById(e250e972-4522-42a0-ace7-ea7578467ea4) } result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36962024-12-12T22:34:43.992ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
36972024-12-12T22:34:43.993ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
36982024-12-12T22:34:43.993ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
36992024-12-12T22:34:43.994ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37002024-12-12T22:34:43.995ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37012024-12-12T22:34:43.995ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37022024-12-12T22:34:43.996ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37032024-12-12T22:34:43.996ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37042024-12-12T22:34:43.997ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37052024-12-12T22:34:43.997ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37062024-12-12T22:34:43.997ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37072024-12-12T22:34:44.001ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000003, lookup_type: ByName("boundary-ntp") } result = Ok(())
37082024-12-12T22:34:44.001ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37092024-12-12T22:34:44.001ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37102024-12-12T22:34:44.002ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37112024-12-12T22:34:44.002ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37122024-12-12T22:34:44.002ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37132024-12-12T22:34:44.003ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37142024-12-12T22:34:44.004ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37152024-12-12T22:34:44.004ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37162024-12-12T22:34:44.004ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37172024-12-12T22:34:44.005ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37182024-12-12T22:34:44.005ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37192024-12-12T22:34:44.005ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37202024-12-12T22:34:44.007ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37212024-12-12T22:34:44.007ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37222024-12-12T22:34:44.007ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37232024-12-12T22:34:44.007ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37242024-12-12T22:34:44.009ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37252024-12-12T22:34:44.009ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37262024-12-12T22:34:44.010ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37272024-12-12T22:34:44.010ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37282024-12-12T22:34:44.010ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37292024-12-12T22:34:44.010ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37302024-12-12T22:34:44.012ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37312024-12-12T22:34:44.012ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37322024-12-12T22:34:44.012ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37332024-12-12T22:34:44.014ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37342024-12-12T22:34:44.015ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
37352024-12-12T22:34:44.015ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37362024-12-12T22:34:44.016ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37372024-12-12T22:34:44.017ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37382024-12-12T22:34:44.017ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37392024-12-12T22:34:44.018ZDEBGnexus (dropshot_external): authorize result action = Modify actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") }, key: e0b70f6b-dcaa-40b4-889f-3b50ad3fe57e, lookup_type: ByName("default") } result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37402024-12-12T22:34:44.018ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac roles = RoleSet { roles: {} } uri = /v1/vpcs/default?project=proj-daa0caca2e6
37412024-12-12T22:34:44.018ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac resource = Database result = Ok(()) uri = /v1/vpcs/default?project=proj-daa0caca2e6
37422024-12-12T22:34:44.018ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37432024-12-12T22:34:44.018ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37442024-12-12T22:34:44.020ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37452024-12-12T22:34:44.020ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37462024-12-12T22:34:44.022ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37472024-12-12T22:34:44.022ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37482024-12-12T22:34:44.023ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 133284 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 157bf23c-b089-45be-b914-c3edd27642ac response_code = 204 uri = /v1/vpcs/default?project=proj-daa0caca2e6
37492024-12-12T22:34:44.023ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37502024-12-12T22:34:44.023ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37512024-12-12T22:34:44.024ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37522024-12-12T22:34:44.024ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37532024-12-12T22:34:44.025ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37542024-12-12T22:34:44.025ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37552024-12-12T22:34:44.026ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37562024-12-12T22:34:44.026ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37572024-12-12T22:34:44.026ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37582024-12-12T22:34:44.027ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37592024-12-12T22:34:44.029ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("token = \\"77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6\\"") } result = Ok(())
37602024-12-12T22:34:44.029ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37612024-12-12T22:34:44.029ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37622024-12-12T22:34:44.030ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37632024-12-12T22:34:44.030ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37642024-12-12T22:34:44.030ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
37652024-12-12T22:34:44.030ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37662024-12-12T22:34:44.030ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37672024-12-12T22:34:44.031ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37682024-12-12T22:34:44.032ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37692024-12-12T22:34:44.032ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37702024-12-12T22:34:44.032ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37712024-12-12T22:34:44.033ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37722024-12-12T22:34:44.033ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37732024-12-12T22:34:44.034ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37742024-12-12T22:34:44.034ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37752024-12-12T22:34:44.034ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37762024-12-12T22:34:44.035ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37772024-12-12T22:34:44.035ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37782024-12-12T22:34:44.035ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
37792024-12-12T22:34:44.035ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37802024-12-12T22:34:44.036ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37812024-12-12T22:34:44.037ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
37822024-12-12T22:34:44.037ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37832024-12-12T22:34:44.038ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37842024-12-12T22:34:44.038ZDEBGnexus (ExternalAuthn): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = ConsoleSession { parent: Fleet, key: "77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6", lookup_type: ByCompositeId("77ac4f0f4ca4b259b52a3dc175778dbbcf0fd4c6") } result = Ok(())
37852024-12-12T22:34:44.038ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37862024-12-12T22:34:44.038ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37872024-12-12T22:34:44.039ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37882024-12-12T22:34:44.039ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37892024-12-12T22:34:44.040ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
37902024-12-12T22:34:44.040ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
37912024-12-12T22:34:44.042ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
37922024-12-12T22:34:44.042ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37932024-12-12T22:34:44.042ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37942024-12-12T22:34:44.043ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37952024-12-12T22:34:44.043ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37962024-12-12T22:34:44.045ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
37972024-12-12T22:34:44.045ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
37982024-12-12T22:34:44.045ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = InternetGateway { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000002, lookup_type: ByName("default") } result = Ok(())
37992024-12-12T22:34:44.045ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
38002024-12-12T22:34:44.046ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38012024-12-12T22:34:44.046ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38022024-12-12T22:34:44.047ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38032024-12-12T22:34:44.048ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fe9d5b16-f75d-4c7b-9ab8-5ab4f4b3bd90", "date": "Thu, 12 Dec 2024 22:34:43 GMT"} })
38042024-12-12T22:34:44.048ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = SiloUser { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 30bf7104-150f-4663-90ba-fce3d41eca1d, lookup_type: ById(30bf7104-150f-4663-90ba-fce3d41eca1d) } result = Ok(())
38052024-12-12T22:34:44.048ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38062024-12-12T22:34:44.049ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38072024-12-12T22:34:44.050ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 160.953531ms iteration = 2 status = {}
38082024-12-12T22:34:44.050ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38092024-12-12T22:34:44.050ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38102024-12-12T22:34:44.051ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {} }
38112024-12-12T22:34:44.052ZDEBGnexus (ExternalAuthn): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Database result = Ok(())
38122024-12-12T22:34:44.053ZDEBGnexus (ExternalAuthn): roles roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "external-authenticator")} }
38132024-12-12T22:34:44.054ZDEBGnexus (ExternalAuthn): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000003, .. }) resource = Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) } result = Ok(())
38142024-12-12T22:34:44.054ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38152024-12-12T22:34:44.054ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38162024-12-12T22:34:44.055ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38172024-12-12T22:34:44.056ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38182024-12-12T22:34:44.057ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38192024-12-12T22:34:44.058ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38202024-12-12T22:34:44.060ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38212024-12-12T22:34:44.060ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38222024-12-12T22:34:44.062ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38232024-12-12T22:34:44.062ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38242024-12-12T22:34:44.065ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38252024-12-12T22:34:44.065ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38262024-12-12T22:34:44.067ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/projects/proj-daa0caca2e6
38272024-12-12T22:34:44.069ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") } result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38282024-12-12T22:34:44.069ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38292024-12-12T22:34:44.069ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38302024-12-12T22:34:44.071ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38312024-12-12T22:34:44.071ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38322024-12-12T22:34:44.073ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38332024-12-12T22:34:44.074ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38342024-12-12T22:34:44.079ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38352024-12-12T22:34:44.079ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38362024-12-12T22:34:44.081ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {(Silo, 207f2d86-9d5c-4ed8-9fa3-55f780829af6, "admin")} } uri = /v1/projects/proj-daa0caca2e6
38372024-12-12T22:34:44.083ZDEBGnexus (dropshot_external): authorize result action = Delete actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Project { parent: Silo { parent: Fleet, key: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, lookup_type: ById(207f2d86-9d5c-4ed8-9fa3-55f780829af6) }, key: 23efd212-aa36-483b-8e8a-e40ef2ca6fc1, lookup_type: ByName("proj-daa0caca2e6") } result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38382024-12-12T22:34:44.083ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38392024-12-12T22:34:44.084ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38402024-12-12T22:34:44.086ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38412024-12-12T22:34:44.086ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38422024-12-12T22:34:44.088ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38432024-12-12T22:34:44.088ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38442024-12-12T22:34:44.115ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38452024-12-12T22:34:44.116ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38462024-12-12T22:34:44.122ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38472024-12-12T22:34:44.122ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38482024-12-12T22:34:44.125ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38492024-12-12T22:34:44.125ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38502024-12-12T22:34:44.127ZDEBGnexus (dropshot_external): roles actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b roles = RoleSet { roles: {} } uri = /v1/projects/proj-daa0caca2e6
38512024-12-12T22:34:44.127ZDEBGnexus (dropshot_external): authorize result action = Query actor = Some(Actor::SiloUser { silo_user_id: 30bf7104-150f-4663-90ba-fce3d41eca1d, silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, .. }) actor_id = 30bf7104-150f-4663-90ba-fce3d41eca1d authenticated = true local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b resource = Database result = Ok(()) uri = /v1/projects/proj-daa0caca2e6
38522024-12-12T22:34:44.136ZINFOnexus (dropshot_external): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 111777 local_addr = 172.30.2.7:443 method = DELETE remote_addr = 10.151.2.100:42495 req_id = 21691bdb-e032-4654-8d60-c0d176b4138b response_code = 204 uri = /v1/projects/proj-daa0caca2e6
38532024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 3 reason = Timeout
38542024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38552024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 3 reason = Timeout
38562024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38572024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38582024-12-12T22:34:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38592024-12-12T22:34:46.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
38602024-12-12T22:34:46.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
38612024-12-12T22:34:46.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38622024-12-12T22:34:46.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
38632024-12-12T22:34:46.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38642024-12-12T22:34:46.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38652024-12-12T22:34:46.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38662024-12-12T22:34:46.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38672024-12-12T22:34:46.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38682024-12-12T22:34:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
38692024-12-12T22:34:46.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
38702024-12-12T22:34:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
38712024-12-12T22:34:46.133ZINFOnexus (BackgroundTasks): found new target blueprint (first find) background_task = blueprint_loader file = nexus/src/app/background/tasks/blueprint_load.rs:88 target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
38722024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 27.932939ms iteration = 3 status = {"enabled":false,"status":"first target blueprint","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z","time_found":"2024-12-12T22:34:46.133249787Z"}
38732024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 2 reason = Dependency
38742024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 2 reason = Dependency
38752024-12-12T22:34:46.133ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
38762024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 14.851\u{b5}s iteration = 2 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
38772024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38782024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38792024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38802024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38812024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38822024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38832024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38842024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38852024-12-12T22:34:46.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38862024-12-12T22:34:46.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38872024-12-12T22:34:46.135ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38882024-12-12T22:34:46.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38892024-12-12T22:34:46.137ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38902024-12-12T22:34:46.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38912024-12-12T22:34:46.137ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38922024-12-12T22:34:46.138ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 33.247443ms iteration = 3 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
38932024-12-12T22:34:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38942024-12-12T22:34:46.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38952024-12-12T22:34:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
38962024-12-12T22:34:46.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
38972024-12-12T22:34:46.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
38982024-12-12T22:34:46.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
38992024-12-12T22:34:46.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39002024-12-12T22:34:46.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39012024-12-12T22:34:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39022024-12-12T22:34:46.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39032024-12-12T22:34:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39042024-12-12T22:34:46.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39052024-12-12T22:34:46.145ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39062024-12-12T22:34:46.145ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39072024-12-12T22:34:46.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39082024-12-12T22:34:46.176ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::4]:32222/node/id
39092024-12-12T22:34:46.208ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::7]:32222/node/id
39102024-12-12T22:34:46.239ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::3]:32222/node/id
39112024-12-12T22:34:46.270ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::6]:32222/node/id
39122024-12-12T22:34:46.301ZDEBGnexus (BackgroundTasks): client request background_task = crdb_node_id_collector body = None method = GET uri = http://[fd00:1122:3344:101::5]:32222/node/id
39132024-12-12T22:34:46.378ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::3]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a773df01-e195-4a30-8cdd-7a4596656fc4", "content-length": "64", "date": "Thu, 12 Dec 2024 22:34:46 GMT"} })
39142024-12-12T22:34:46.378ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39152024-12-12T22:34:46.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39162024-12-12T22:34:46.380ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39172024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39182024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39192024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39202024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::6]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "839ad552-ed7e-45ad-8980-4fd83aab9088", "content-length": "64", "date": "Thu, 12 Dec 2024 22:34:46 GMT"} })
39212024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39222024-12-12T22:34:46.382ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39232024-12-12T22:34:46.384ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39242024-12-12T22:34:46.385ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39252024-12-12T22:34:46.385ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39262024-12-12T22:34:46.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39272024-12-12T22:34:46.403ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::7]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3f27582-a440-4b5f-831c-fb387be19a06", "content-length": "64", "date": "Thu, 12 Dec 2024 22:34:46 GMT"} })
39282024-12-12T22:34:46.403ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39292024-12-12T22:34:46.404ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39302024-12-12T22:34:46.405ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39312024-12-12T22:34:46.406ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39322024-12-12T22:34:46.406ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39332024-12-12T22:34:46.406ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39342024-12-12T22:34:46.415ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::5]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d70a0dd7-18f1-4b20-8abb-48082eaa0d07", "content-length": "64", "date": "Thu, 12 Dec 2024 22:34:46 GMT"} })
39352024-12-12T22:34:46.415ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39362024-12-12T22:34:46.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39372024-12-12T22:34:46.416ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39382024-12-12T22:34:46.417ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39392024-12-12T22:34:46.418ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39402024-12-12T22:34:46.418ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39412024-12-12T22:34:46.497ZDEBGnexus (BackgroundTasks): client response background_task = crdb_node_id_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::4]:32222/node/id", status: 200, headers: {"content-type": "application/json", "x-request-id": "80526847-06d6-43af-9627-3367d0bda9be", "content-length": "64", "date": "Thu, 12 Dec 2024 22:34:46 GMT"} })
39422024-12-12T22:34:46.497ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39432024-12-12T22:34:46.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39442024-12-12T22:34:46.499ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
39452024-12-12T22:34:46.500ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
39462024-12-12T22:34:46.500ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
39472024-12-12T22:34:46.500ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
39482024-12-12T22:34:46.511ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 378.173508ms iteration = 2 status = {"nsuccess":5}
39492024-12-12T22:34:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 55df3252-fd9e-4ae6-9e6a-f74cbff21126 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
39502024-12-12T22:34:47.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 55df3252-fd9e-4ae6-9e6a-f74cbff21126 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
39512024-12-12T22:34:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3152 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 55df3252-fd9e-4ae6-9e6a-f74cbff21126 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
39522024-12-12T22:34:47.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 7e5da848-af29-4e7f-821e-c15753993c56 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
39532024-12-12T22:34:47.184ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 7e5da848-af29-4e7f-821e-c15753993c56 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
39542024-12-12T22:34:47.186ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 7e5da848-af29-4e7f-821e-c15753993c56 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
39552024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 2 reason = Timeout
39562024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 2 reason = Timeout
39572024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
39582024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 4 reason = Timeout
39592024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
39602024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
39612024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 2 reason = Timeout
39622024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 4 reason = Timeout
39632024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
39642024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 2 reason = Timeout
39652024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
39662024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 2 reason = Timeout
39672024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
39682024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
39692024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 2 reason = Timeout
39702024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
39712024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
39722024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 4 reason = Timeout
39732024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 2 reason = Timeout
39742024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
39752024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 2 reason = Timeout
39762024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
39772024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 2 reason = Timeout
39782024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 3 reason = Timeout
39792024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
39802024-12-12T22:34:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
39812024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
39822024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 2 reason = Timeout
39832024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
39842024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 2 reason = Timeout
39852024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
39862024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 2 reason = Timeout
39872024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
39882024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 2 reason = Timeout
39892024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
39902024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
39912024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
39922024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
39932024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
39942024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
39952024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
39962024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
39972024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
39982024-12-12T22:34:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
39992024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40002024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40012024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
40022024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
40032024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
40042024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40052024-12-12T22:34:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40062024-12-12T22:34:56.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.464369ms iteration = 2 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
40072024-12-12T22:34:56.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40082024-12-12T22:34:56.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40092024-12-12T22:34:56.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40102024-12-12T22:34:56.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40112024-12-12T22:34:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
40122024-12-12T22:34:56.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
40132024-12-12T22:34:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
40142024-12-12T22:34:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
40152024-12-12T22:34:56.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
40162024-12-12T22:34:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40172024-12-12T22:34:56.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40182024-12-12T22:34:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
40192024-12-12T22:34:56.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40202024-12-12T22:34:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
40212024-12-12T22:34:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40222024-12-12T22:34:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40232024-12-12T22:34:56.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40242024-12-12T22:34:56.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3427, tv_nsec: 38215070 } })
40252024-12-12T22:34:56.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
40262024-12-12T22:34:56.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3427, tv_nsec: 38599508 } })
40272024-12-12T22:34:56.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
40282024-12-12T22:34:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
40292024-12-12T22:34:56.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40302024-12-12T22:34:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40312024-12-12T22:34:56.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40322024-12-12T22:34:56.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40332024-12-12T22:34:56.126ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40342024-12-12T22:34:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40352024-12-12T22:34:56.127ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
40362024-12-12T22:34:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
40372024-12-12T22:34:56.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3427, tv_nsec: 50228026 } })
40382024-12-12T22:34:56.128ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40392024-12-12T22:34:56.128ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
40402024-12-12T22:34:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40412024-12-12T22:34:56.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40422024-12-12T22:34:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40432024-12-12T22:34:56.130ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40442024-12-12T22:34:56.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
40452024-12-12T22:34:56.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
40462024-12-12T22:34:56.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
40472024-12-12T22:34:56.135ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40482024-12-12T22:34:56.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40492024-12-12T22:34:56.147ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
40502024-12-12T22:34:56.147ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40512024-12-12T22:34:56.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40522024-12-12T22:34:56.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
40532024-12-12T22:34:56.148ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40542024-12-12T22:34:56.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40552024-12-12T22:34:56.149ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40562024-12-12T22:34:56.149ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 44.530335ms iteration = 4 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
40572024-12-12T22:34:56.151ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40582024-12-12T22:34:56.151ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40592024-12-12T22:34:56.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40602024-12-12T22:34:56.153ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40612024-12-12T22:34:56.153ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40622024-12-12T22:34:56.153ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
40632024-12-12T22:34:56.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40642024-12-12T22:34:56.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40652024-12-12T22:34:56.155ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
40662024-12-12T22:34:56.155ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
40672024-12-12T22:34:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
40682024-12-12T22:34:56.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40692024-12-12T22:34:56.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.313057ms iteration = 2 status = {"errors":[],"records_set_to_done":[]}
40702024-12-12T22:34:56.161ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
40712024-12-12T22:34:56.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
40722024-12-12T22:34:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
40732024-12-12T22:34:56.162ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
40742024-12-12T22:34:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
40752024-12-12T22:34:56.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
40762024-12-12T22:34:56.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
40772024-12-12T22:34:56.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.12487ms iteration = 2 status = {"errors":[],"garbage_collect_requested":[]}
40782024-12-12T22:34:56.171ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
40792024-12-12T22:34:56.171ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.21722ms iteration = 2 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
40802024-12-12T22:34:56.174ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
40812024-12-12T22:34:56.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
40822024-12-12T22:34:56.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
40832024-12-12T22:34:56.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
40842024-12-12T22:34:56.188ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
40852024-12-12T22:34:56.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
40862024-12-12T22:34:56.194ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
40872024-12-12T22:34:56.194ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
40882024-12-12T22:34:56.194ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
40892024-12-12T22:34:56.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
40902024-12-12T22:34:56.196ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
40912024-12-12T22:34:56.196ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 90.664561ms iteration = 4 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
40922024-12-12T22:34:56.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 93.895635ms iteration = 2 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
40932024-12-12T22:34:56.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 97.739619ms iteration = 2 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
40942024-12-12T22:34:56.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 114.455638ms iteration = 2 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
40952024-12-12T22:34:56.224ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
40962024-12-12T22:34:56.224ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
40972024-12-12T22:34:56.224ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8166ce90-b7a7-45ef-918d-fc0f83697837", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:55 GMT"} })
40982024-12-12T22:34:56.224ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
40992024-12-12T22:34:56.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41002024-12-12T22:34:56.244ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 139.073071ms iteration = 4 status = {"physical_disks_added":0}
41012024-12-12T22:34:56.249ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
41022024-12-12T22:34:56.249ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41032024-12-12T22:34:56.250ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "85a093b5-9ddd-4073-8e79-759c110ee524", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41042024-12-12T22:34:56.250ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41052024-12-12T22:34:56.251ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
41062024-12-12T22:34:56.262ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
41072024-12-12T22:34:56.262ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
41082024-12-12T22:34:56.262ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8a74ceed-b63c-4348-997e-dd741f222d53", "content-length": "26", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41092024-12-12T22:34:56.262ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
41102024-12-12T22:34:56.263ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
41112024-12-12T22:34:56.272ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41122024-12-12T22:34:56.272ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41132024-12-12T22:34:56.350ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
41142024-12-12T22:34:56.350ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87f80cd5-b121-4cb2-a598-2f6a629c88ef", "content-length": "691", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41152024-12-12T22:34:56.350ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
41162024-12-12T22:34:56.350ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
41172024-12-12T22:34:56.350ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
41182024-12-12T22:34:56.351ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 246.375228ms iteration = 2 status = {}
41192024-12-12T22:34:56.367ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
41202024-12-12T22:34:56.367ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cfca791e-ea58-4dee-ad4c-50687041f68e", "content-length": "1", "date": "Thu, 12 Dec 2024 22:34:55 GMT"} })
41212024-12-12T22:34:56.368ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
41222024-12-12T22:34:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
41232024-12-12T22:34:56.373ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
41242024-12-12T22:34:56.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41252024-12-12T22:34:56.373ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "dc45b908-7e1d-4be4-9f6d-99a3d51cf75c", "content-length": "372", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41262024-12-12T22:34:56.373ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41272024-12-12T22:34:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41282024-12-12T22:34:56.376ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41292024-12-12T22:34:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41302024-12-12T22:34:56.376ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 271.172206ms iteration = 2 status = null
41312024-12-12T22:34:56.378ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
41322024-12-12T22:34:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
41332024-12-12T22:34:56.381ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
41342024-12-12T22:34:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
41352024-12-12T22:34:56.383ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 277.760955ms iteration = 2 status = 0
41362024-12-12T22:34:56.403ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
41372024-12-12T22:34:56.403ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
41382024-12-12T22:34:56.403ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 298.526243ms iteration = 2 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
41392024-12-12T22:34:56.409ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 304.059761ms iteration = 2 status = {}
41402024-12-12T22:34:56.413ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
41412024-12-12T22:34:56.413ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
41422024-12-12T22:34:56.413ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "30dad801-4f68-42a4-8e94-4c8e72f23a44", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41432024-12-12T22:34:56.413ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41442024-12-12T22:34:56.413ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41452024-12-12T22:34:56.415ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41462024-12-12T22:34:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41472024-12-12T22:34:56.419ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
41482024-12-12T22:34:56.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
41492024-12-12T22:34:56.427ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
41502024-12-12T22:34:56.427ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
41512024-12-12T22:34:56.427ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a87c7607-dd4a-48a9-8fd4-37d4efc73d43", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41522024-12-12T22:34:56.428ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 323.343901ms iteration = 3 status = {}
41532024-12-12T22:34:56.459ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41542024-12-12T22:34:56.460ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41552024-12-12T22:34:56.462ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
41562024-12-12T22:34:56.462ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41572024-12-12T22:34:56.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41582024-12-12T22:34:56.479ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
41592024-12-12T22:34:56.479ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0104ef4-df6a-4d23-89a3-6bdf39c3554c", "content-length": "134", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41602024-12-12T22:34:56.481ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
41612024-12-12T22:34:56.481ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
41622024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
41632024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
41642024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41652024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41662024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41672024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41682024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
41692024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
41702024-12-12T22:34:56.482ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
41712024-12-12T22:34:56.482ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41722024-12-12T22:34:56.482ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41732024-12-12T22:34:56.485ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
41742024-12-12T22:34:56.485ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "e814266e-367d-44aa-8e6c-cf6eca7f65d8", "content-length": "2", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41752024-12-12T22:34:56.485ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
41762024-12-12T22:34:56.485ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "f228e5a4-bcfb-44f4-8a7e-9d49e83ef5db", "content-length": "52", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41772024-12-12T22:34:56.485ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
41782024-12-12T22:34:56.485ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
41792024-12-12T22:34:56.571ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0ed9dd43-fccf-44c8-affe-564bcc660618", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41802024-12-12T22:34:56.572ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
41812024-12-12T22:34:56.572ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
41822024-12-12T22:34:56.572ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "21becac2-ca40-44d9-89a6-350d27d4fc33", "content-length": "682", "date": "Thu, 12 Dec 2024 22:34:56 GMT"} })
41832024-12-12T22:34:56.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41842024-12-12T22:34:56.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41852024-12-12T22:34:56.583ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41862024-12-12T22:34:56.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41872024-12-12T22:34:56.586ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41882024-12-12T22:34:56.586ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41892024-12-12T22:34:56.589ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
41902024-12-12T22:34:56.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
41912024-12-12T22:34:56.597ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 491.82926ms iteration = 2 status = {}
41922024-12-12T22:34:57.188ZINFOnexus (dropshot): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:43664 remote_addr = [fd00:1122:3344:101::d]:42878
41932024-12-12T22:34:57.194ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 6131 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = f0c3dd65-59f4-4930-9c28-184adc04c10e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
41942024-12-12T22:35:02.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = a2dcda01-c0dd-4d6c-b2d0-91ff8fc961fc roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
41952024-12-12T22:35:02.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = a2dcda01-c0dd-4d6c-b2d0-91ff8fc961fc resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
41962024-12-12T22:35:02.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3156 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = a2dcda01-c0dd-4d6c-b2d0-91ff8fc961fc response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
41972024-12-12T22:35:02.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = d4fd7d48-a972-40de-941c-7a0033d5755e roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
41982024-12-12T22:35:02.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = d4fd7d48-a972-40de-941c-7a0033d5755e resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
41992024-12-12T22:35:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2655 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = d4fd7d48-a972-40de-941c-7a0033d5755e response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
42002024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 5 reason = Timeout
42012024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 5 reason = Timeout
42022024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42032024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42042024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42052024-12-12T22:35:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42062024-12-12T22:35:06.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42072024-12-12T22:35:06.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42082024-12-12T22:35:06.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42092024-12-12T22:35:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42102024-12-12T22:35:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42112024-12-12T22:35:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42122024-12-12T22:35:06.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.952107ms iteration = 5 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42132024-12-12T22:35:06.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42142024-12-12T22:35:06.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42152024-12-12T22:35:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42162024-12-12T22:35:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
42172024-12-12T22:35:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42182024-12-12T22:35:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42192024-12-12T22:35:06.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
42202024-12-12T22:35:06.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.546833ms iteration = 5 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
42212024-12-12T22:35:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1155 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 2d25386d-7978-4685-87b0-daec696c05d3 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
42222024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 6 reason = Timeout
42232024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42242024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 6 reason = Timeout
42252024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42262024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42272024-12-12T22:35:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42282024-12-12T22:35:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42292024-12-12T22:35:16.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
42302024-12-12T22:35:16.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
42312024-12-12T22:35:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
42322024-12-12T22:35:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42332024-12-12T22:35:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42342024-12-12T22:35:16.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42352024-12-12T22:35:16.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42362024-12-12T22:35:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
42372024-12-12T22:35:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
42382024-12-12T22:35:16.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
42392024-12-12T22:35:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
42402024-12-12T22:35:16.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
42412024-12-12T22:35:16.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.751926ms iteration = 6 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
42422024-12-12T22:35:16.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.333366ms iteration = 6 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
42432024-12-12T22:35:17.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 1554e141-fb64-4cd4-887f-f3d096ca207a roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
42442024-12-12T22:35:17.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 1554e141-fb64-4cd4-887f-f3d096ca207a resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
42452024-12-12T22:35:17.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2745 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = 1554e141-fb64-4cd4-887f-f3d096ca207a response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
42462024-12-12T22:35:17.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = f76203ad-358a-4cd7-80b2-69f9301ade1d roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
42472024-12-12T22:35:17.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = f76203ad-358a-4cd7-80b2-69f9301ade1d resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
42482024-12-12T22:35:17.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2859 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:34794 req_id = f76203ad-358a-4cd7-80b2-69f9301ade1d response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJiYjlkY2EyOC1kZWExLTQxMDUtYjAxNS05YWY0YTVjY2NlN2UifX0%3D
42492024-12-12T22:35:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1091 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 67277b67-41f1-4770-9d6a-9462a7a984fc response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
42502024-12-12T22:35:18.235ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41632
42512024-12-12T22:35:18.235ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41632 req_id = 7ed85ef8-4674-4772-a46f-b4d507c8fcc7 roles = RoleSet { roles: {} } uri = /metrics/producers
42522024-12-12T22:35:18.236ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41632 req_id = 7ed85ef8-4674-4772-a46f-b4d507c8fcc7 resource = Database result = Ok(()) uri = /metrics/producers
42532024-12-12T22:35:18.326ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 4a8c9490-d35a-4221-8585-e4103b325118
42542024-12-12T22:35:18.326ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 90275 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41632 req_id = 7ed85ef8-4674-4772-a46f-b4d507c8fcc7 response_code = 201 uri = /metrics/producers
42552024-12-12T22:35:24.930ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:56014
42562024-12-12T22:35:24.931ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56014 req_id = cae6f86a-9070-4d2d-8223-a8b12942e74a roles = RoleSet { roles: {} } uri = /metrics/producers
42572024-12-12T22:35:24.931ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56014 req_id = cae6f86a-9070-4d2d-8223-a8b12942e74a resource = Database result = Ok(()) uri = /metrics/producers
42582024-12-12T22:35:24.965ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e7680fb8-0ccd-466c-b928-9ebe5b97f2ca
42592024-12-12T22:35:24.965ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34815 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:56014 req_id = cae6f86a-9070-4d2d-8223-a8b12942e74a response_code = 201 uri = /metrics/producers
42602024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 3 reason = Timeout
42612024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 3 reason = Timeout
42622024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
42632024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 4 reason = Timeout
42642024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 3 reason = Timeout
42652024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
42662024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 3 reason = Timeout
42672024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
42682024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 2 reason = Timeout
42692024-12-12T22:35:26.104ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
42702024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
42712024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 3 reason = Timeout
42722024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 3 reason = Timeout
42732024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
42742024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
42752024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 5 reason = Timeout
42762024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 2 reason = Timeout
42772024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
42782024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 3 reason = Timeout
42792024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
42802024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
42812024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 3 reason = Timeout
42822024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
42832024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 4 reason = Timeout
42842024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 3 reason = Timeout
42852024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 2 reason = Timeout
42862024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
42872024-12-12T22:35:26.104ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:25:26.104893797 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
42882024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
42892024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 3 reason = Timeout
42902024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 3 reason = Timeout
42912024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 3 reason = Timeout
42922024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
42932024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
42942024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
42952024-12-12T22:35:26.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 4 reason = Timeout
42962024-12-12T22:35:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
42972024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 3 reason = Timeout
42982024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
42992024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
43002024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43012024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 7 reason = Timeout
43022024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
43032024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 3 reason = Timeout
43042024-12-12T22:35:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
43052024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 7 reason = Timeout
43062024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.74\u{b5}s iteration = 3 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
43072024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43082024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 3 reason = Timeout
43092024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
43102024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43112024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43122024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
43132024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
43142024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43152024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
43162024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
43172024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43182024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43192024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
43202024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43212024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43222024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
43232024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43242024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43252024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
43262024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
43272024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
43282024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 2 reason = Timeout
43292024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
43302024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 3 reason = Timeout
43312024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
43322024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 3 reason = Timeout
43332024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
43342024-12-12T22:35:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 27287548 } })
43352024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 3 reason = Timeout
43362024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
43372024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 3 reason = Timeout
43382024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43392024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 2 reason = Timeout
43402024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
43412024-12-12T22:35:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 27346639 } })
43422024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
43432024-12-12T22:35:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
43442024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
43452024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
43462024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43472024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
43482024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
43492024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.328346ms iteration = 3 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
43502024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
43512024-12-12T22:35:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.574561ms iteration = 3 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
43522024-12-12T22:35:26.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43532024-12-12T22:35:26.107ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43542024-12-12T22:35:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.983878ms iteration = 3 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
43552024-12-12T22:35:26.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43562024-12-12T22:35:26.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
43572024-12-12T22:35:26.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
43582024-12-12T22:35:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
43592024-12-12T22:35:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
43602024-12-12T22:35:26.110ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
43612024-12-12T22:35:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
43622024-12-12T22:35:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
43632024-12-12T22:35:26.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
43642024-12-12T22:35:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
43652024-12-12T22:35:26.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43662024-12-12T22:35:26.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43672024-12-12T22:35:26.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
43682024-12-12T22:35:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
43692024-12-12T22:35:26.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43702024-12-12T22:35:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
43712024-12-12T22:35:26.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43722024-12-12T22:35:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43732024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
43742024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
43752024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
43762024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
43772024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
43782024-12-12T22:35:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
43792024-12-12T22:35:26.117ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:25:26.104893797 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
43802024-12-12T22:35:26.117ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 13.061446ms iteration = 2 status = {"expiration":"2024-12-12T22:25:26.104893797Z","pruned":[]}
43812024-12-12T22:35:26.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
43822024-12-12T22:35:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
43832024-12-12T22:35:26.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43842024-12-12T22:35:26.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 46226820 } })
43852024-12-12T22:35:26.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
43862024-12-12T22:35:26.125ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
43872024-12-12T22:35:26.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
43882024-12-12T22:35:26.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
43892024-12-12T22:35:26.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 47159368 } })
43902024-12-12T22:35:26.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
43912024-12-12T22:35:26.133ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.939018ms iteration = 2 status = {"errors":[],"found_port_ok":[]}
43922024-12-12T22:35:26.134ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3457, tv_nsec: 55713236 } })
43932024-12-12T22:35:26.134ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
43942024-12-12T22:35:26.136ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
43952024-12-12T22:35:26.138ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
43962024-12-12T22:35:26.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
43972024-12-12T22:35:26.139ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
43982024-12-12T22:35:26.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
43992024-12-12T22:35:26.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44002024-12-12T22:35:26.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44012024-12-12T22:35:26.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44022024-12-12T22:35:26.146ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44032024-12-12T22:35:26.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44042024-12-12T22:35:26.150ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44052024-12-12T22:35:26.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44062024-12-12T22:35:26.163ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44072024-12-12T22:35:26.163ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
44082024-12-12T22:35:26.163ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44092024-12-12T22:35:26.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44102024-12-12T22:35:26.171ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
44112024-12-12T22:35:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
44122024-12-12T22:35:26.173ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
44132024-12-12T22:35:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
44142024-12-12T22:35:26.175ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44152024-12-12T22:35:26.177ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
44162024-12-12T22:35:26.177ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
44172024-12-12T22:35:26.177ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.25474ms iteration = 2 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
44182024-12-12T22:35:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
44192024-12-12T22:35:26.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44202024-12-12T22:35:26.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44212024-12-12T22:35:26.186ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 81.678284ms iteration = 3 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
44222024-12-12T22:35:26.186ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
44232024-12-12T22:35:26.186ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 81.850587ms iteration = 3 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
44242024-12-12T22:35:26.188ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
44252024-12-12T22:35:26.188ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
44262024-12-12T22:35:26.188ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 83.745295ms iteration = 2 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
44272024-12-12T22:35:26.191ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44282024-12-12T22:35:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44292024-12-12T22:35:26.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44302024-12-12T22:35:26.196ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 90.550668ms iteration = 3 status = {"errors":[],"garbage_collect_requested":[]}
44312024-12-12T22:35:26.198ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44322024-12-12T22:35:26.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44332024-12-12T22:35:26.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44342024-12-12T22:35:26.201ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44352024-12-12T22:35:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 96.128068ms iteration = 3 status = {"errors":[],"records_set_to_done":[]}
44362024-12-12T22:35:26.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
44372024-12-12T22:35:26.204ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44382024-12-12T22:35:26.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.434414ms iteration = 3 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
44392024-12-12T22:35:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
44402024-12-12T22:35:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
44412024-12-12T22:35:26.205ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
44422024-12-12T22:35:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
44432024-12-12T22:35:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
44442024-12-12T22:35:26.207ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
44452024-12-12T22:35:26.207ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44462024-12-12T22:35:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
44472024-12-12T22:35:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44482024-12-12T22:35:26.210ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
44492024-12-12T22:35:26.210ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
44502024-12-12T22:35:26.210ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
44512024-12-12T22:35:26.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44522024-12-12T22:35:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44532024-12-12T22:35:26.212ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44542024-12-12T22:35:26.212ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44552024-12-12T22:35:26.212ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44562024-12-12T22:35:26.217ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44572024-12-12T22:35:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44582024-12-12T22:35:26.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44592024-12-12T22:35:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44602024-12-12T22:35:26.219ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
44612024-12-12T22:35:26.219ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
44622024-12-12T22:35:26.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
44632024-12-12T22:35:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 117.285334ms iteration = 3 status = 0
44642024-12-12T22:35:26.234ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 129.631056ms iteration = 7 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
44652024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44662024-12-12T22:35:26.235ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44672024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
44682024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
44692024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44702024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
44712024-12-12T22:35:26.235ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 130.686927ms iteration = 7 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
44722024-12-12T22:35:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
44732024-12-12T22:35:26.237ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44742024-12-12T22:35:26.239ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
44752024-12-12T22:35:26.239ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
44762024-12-12T22:35:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
44772024-12-12T22:35:26.242ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
44782024-12-12T22:35:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
44792024-12-12T22:35:26.244ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44802024-12-12T22:35:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 138.942839ms iteration = 3 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
44812024-12-12T22:35:26.246ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
44822024-12-12T22:35:26.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
44832024-12-12T22:35:26.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
44842024-12-12T22:35:26.255ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44852024-12-12T22:35:26.257ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
44862024-12-12T22:35:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
44872024-12-12T22:35:26.258ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
44882024-12-12T22:35:26.268ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
44892024-12-12T22:35:26.268ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
44902024-12-12T22:35:26.268ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44912024-12-12T22:35:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44922024-12-12T22:35:26.274ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
44932024-12-12T22:35:26.274ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
44942024-12-12T22:35:26.274ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
44952024-12-12T22:35:26.274ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 170.203303ms iteration = 3 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
44962024-12-12T22:35:26.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
44972024-12-12T22:35:26.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
44982024-12-12T22:35:26.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
44992024-12-12T22:35:26.279ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
45002024-12-12T22:35:26.279ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
45012024-12-12T22:35:26.279ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
45022024-12-12T22:35:26.279ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 174.939906ms iteration = 3 status = {"generation":2}
45032024-12-12T22:35:26.288ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(2)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
45042024-12-12T22:35:26.288ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 183.724819ms iteration = 3 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
45052024-12-12T22:35:26.289ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45062024-12-12T22:35:26.289ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45072024-12-12T22:35:26.289ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b19ab86c-1f7b-497a-81e0-a9b606c3e76c", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45082024-12-12T22:35:26.289ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45092024-12-12T22:35:26.291ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45102024-12-12T22:35:26.295ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
45112024-12-12T22:35:26.295ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
45122024-12-12T22:35:26.295ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
45132024-12-12T22:35:26.295ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45142024-12-12T22:35:26.295ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45152024-12-12T22:35:26.296ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45162024-12-12T22:35:26.301ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45172024-12-12T22:35:26.301ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45182024-12-12T22:35:26.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45192024-12-12T22:35:26.319ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
45202024-12-12T22:35:26.319ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 214.33116ms iteration = 2 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
45212024-12-12T22:35:26.331ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 226.237274ms iteration = 5 status = {"physical_disks_added":0}
45222024-12-12T22:35:26.341ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
45232024-12-12T22:35:26.341ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
45242024-12-12T22:35:26.341ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45252024-12-12T22:35:26.342ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45262024-12-12T22:35:26.344ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45272024-12-12T22:35:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
45282024-12-12T22:35:26.348ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
45292024-12-12T22:35:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
45302024-12-12T22:35:26.359ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
45312024-12-12T22:35:26.374ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45322024-12-12T22:35:26.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45332024-12-12T22:35:26.399ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
45342024-12-12T22:35:26.412ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
45352024-12-12T22:35:26.412ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45362024-12-12T22:35:26.413ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "04c9a259-4cbd-4e89-ba9d-16871ebe080a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45372024-12-12T22:35:26.413ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45382024-12-12T22:35:26.414ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
45392024-12-12T22:35:26.424ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
45402024-12-12T22:35:26.424ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
45412024-12-12T22:35:26.424ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "87ce7fcd-b042-461c-be0e-0f6340b5fc38", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45422024-12-12T22:35:26.424ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
45432024-12-12T22:35:26.426ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
45442024-12-12T22:35:26.449ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
45452024-12-12T22:35:26.449ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "759b95b3-4462-4095-8f77-8f1696f1f022", "content-length": "1", "date": "Thu, 12 Dec 2024 22:35:25 GMT"} })
45462024-12-12T22:35:26.451ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
45472024-12-12T22:35:26.451ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
45482024-12-12T22:35:26.467ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
45492024-12-12T22:35:26.467ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45502024-12-12T22:35:26.469ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45512024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "7eda2355-f92d-4972-ab3e-8f6178709a0c", "content-length": "372", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45522024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45532024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45542024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45552024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45562024-12-12T22:35:26.471ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45572024-12-12T22:35:26.472ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
45582024-12-12T22:35:26.472ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
45592024-12-12T22:35:26.472ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
45602024-12-12T22:35:26.472ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 367.728253ms iteration = 3 status = {"generation":1}
45612024-12-12T22:35:26.473ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 368.515767ms iteration = 3 status = null
45622024-12-12T22:35:26.473ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
45632024-12-12T22:35:26.475ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
45642024-12-12T22:35:26.475ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
45652024-12-12T22:35:26.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
45662024-12-12T22:35:26.528ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
45672024-12-12T22:35:26.528ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
45682024-12-12T22:35:26.528ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3d7458e9-4fe8-48bb-9cb5-41321be72c1e", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45692024-12-12T22:35:26.528ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45702024-12-12T22:35:26.528ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45712024-12-12T22:35:26.530ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45722024-12-12T22:35:26.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45732024-12-12T22:35:26.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
45742024-12-12T22:35:26.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
45752024-12-12T22:35:26.537ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
45762024-12-12T22:35:26.537ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
45772024-12-12T22:35:26.537ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "39aa878c-2b1b-4dcf-bfbd-0091754f88e9", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45782024-12-12T22:35:26.538ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 433.881901ms iteration = 4 status = {}
45792024-12-12T22:35:26.586ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 481.786203ms iteration = 3 status = {}
45802024-12-12T22:35:26.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
45812024-12-12T22:35:26.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "7694d64c-fe2a-4cf4-a1d2-1847b898dcb7", "content-length": "691", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
45822024-12-12T22:35:26.613ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
45832024-12-12T22:35:26.613ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
45842024-12-12T22:35:26.613ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
45852024-12-12T22:35:26.614ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 509.935275ms iteration = 3 status = {}
45862024-12-12T22:35:26.622ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
45872024-12-12T22:35:26.663ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
45882024-12-12T22:35:26.664ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "63e76708-1257-4bd4-ae69-ea61fc3089f2", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45892024-12-12T22:35:26.664ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45902024-12-12T22:35:26.666ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "55e3a3a1-ee05-41eb-931f-65d6631cf180", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45912024-12-12T22:35:26.666ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45922024-12-12T22:35:26.668ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
45932024-12-12T22:35:26.668ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 563.462847ms iteration = 4 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
45942024-12-12T22:35:26.717ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
45952024-12-12T22:35:26.717ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "70278cd9-c313-490b-ba1f-871a1ff18cc2", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45962024-12-12T22:35:26.717ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45972024-12-12T22:35:26.719ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "3f4dc4c3-3abc-4974-abaa-f9541c325082", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45982024-12-12T22:35:26.719ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
45992024-12-12T22:35:26.720ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "83dfff12-5a2b-4b68-a29e-6404116800c3", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
46002024-12-12T22:35:26.720ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
46012024-12-12T22:35:26.722ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
46022024-12-12T22:35:26.722ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 617.689382ms iteration = 4 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
46032024-12-12T22:35:26.730ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46042024-12-12T22:35:26.730ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46052024-12-12T22:35:26.733ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
46062024-12-12T22:35:26.733ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46072024-12-12T22:35:26.733ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46082024-12-12T22:35:26.797ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
46092024-12-12T22:35:26.797ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "01ad71a2-66d3-40a0-bd49-e440ed420401", "content-length": "134", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
46102024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
46112024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
46122024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
46132024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
46142024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46152024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46162024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46172024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46182024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
46192024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
46202024-12-12T22:35:26.798ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
46212024-12-12T22:35:26.798ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46222024-12-12T22:35:26.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46232024-12-12T22:35:26.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
46242024-12-12T22:35:26.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "f8edee23-98ea-47d7-a7db-d686ad3742c9", "content-length": "2", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
46252024-12-12T22:35:26.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
46262024-12-12T22:35:26.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b1dc407-0373-4c28-9180-3b03bc402fd7", "content-length": "52", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
46272024-12-12T22:35:26.801ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
46282024-12-12T22:35:26.801ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
46292024-12-12T22:35:26.898ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "dd28cf16-b13e-40ae-b4cf-4ac653e302db", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
46302024-12-12T22:35:26.898ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
46312024-12-12T22:35:26.898ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
46322024-12-12T22:35:26.898ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1dd79e23-f832-4dc7-9ccf-944ab408647a", "content-length": "682", "date": "Thu, 12 Dec 2024 22:35:26 GMT"} })
46332024-12-12T22:35:26.898ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46342024-12-12T22:35:26.899ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46352024-12-12T22:35:26.915ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46362024-12-12T22:35:26.916ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46372024-12-12T22:35:26.920ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46382024-12-12T22:35:26.920ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46392024-12-12T22:35:26.923ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
46402024-12-12T22:35:26.923ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
46412024-12-12T22:35:26.929ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 825.050405ms iteration = 3 status = {}
46422024-12-12T22:35:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1052 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = df9e48e1-2b50-40a8-b8bb-a976fcc63f11 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
46432024-12-12T22:35:32.973ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43579
46442024-12-12T22:35:32.973ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43579 req_id = 0af458a6-ccda-41dc-a22e-bd8c086953e1 roles = RoleSet { roles: {} } uri = /metrics/producers
46452024-12-12T22:35:32.974ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43579 req_id = 0af458a6-ccda-41dc-a22e-bd8c086953e1 resource = Database result = Ok(()) uri = /metrics/producers
46462024-12-12T22:35:32.985ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 9be55e3b-79ee-4930-a117-2473cfadb163
46472024-12-12T22:35:32.985ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 11859 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43579 req_id = 0af458a6-ccda-41dc-a22e-bd8c086953e1 response_code = 201 uri = /metrics/producers
46482024-12-12T22:35:35.134ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:43240
46492024-12-12T22:35:35.136ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43240 req_id = 4fdbdcd0-e50c-4d0d-8868-e8eb32b5889c roles = RoleSet { roles: {} } uri = /metrics/producers
46502024-12-12T22:35:35.136ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43240 req_id = 4fdbdcd0-e50c-4d0d-8868-e8eb32b5889c resource = Database result = Ok(()) uri = /metrics/producers
46512024-12-12T22:35:35.144ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e736935f-49fd-4441-90a4-7226a6f1fe8e
46522024-12-12T22:35:35.144ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 8497 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:43240 req_id = 4fdbdcd0-e50c-4d0d-8868-e8eb32b5889c response_code = 201 uri = /metrics/producers
46532024-12-12T22:35:35.782ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:41660
46542024-12-12T22:35:35.783ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41660 req_id = 75db1977-4848-4e8b-abef-37ce42186a9f roles = RoleSet { roles: {} } uri = /metrics/producers
46552024-12-12T22:35:35.784ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41660 req_id = 75db1977-4848-4e8b-abef-37ce42186a9f resource = Database result = Ok(()) uri = /metrics/producers
46562024-12-12T22:35:35.825ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 35574f6f-1e6c-4add-9efb-f5d5c83e2007
46572024-12-12T22:35:35.825ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42280 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:41660 req_id = 75db1977-4848-4e8b-abef-37ce42186a9f response_code = 201 uri = /metrics/producers
46582024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 8 reason = Timeout
46592024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46602024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 8 reason = Timeout
46612024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46622024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46632024-12-12T22:35:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46642024-12-12T22:35:36.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46652024-12-12T22:35:36.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46662024-12-12T22:35:36.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46672024-12-12T22:35:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46682024-12-12T22:35:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46692024-12-12T22:35:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46702024-12-12T22:35:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46712024-12-12T22:35:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46722024-12-12T22:35:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46732024-12-12T22:35:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
46742024-12-12T22:35:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46752024-12-12T22:35:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46762024-12-12T22:35:36.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
46772024-12-12T22:35:36.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.715317ms iteration = 8 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
46782024-12-12T22:35:36.140ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 35.031898ms iteration = 8 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
46792024-12-12T22:35:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1058 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = adde8c1a-22c3-4832-939c-a67c99f99096 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
46802024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 9 reason = Timeout
46812024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46822024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 9 reason = Timeout
46832024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46842024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46852024-12-12T22:35:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46862024-12-12T22:35:46.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46872024-12-12T22:35:46.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
46882024-12-12T22:35:46.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
46892024-12-12T22:35:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
46902024-12-12T22:35:46.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46912024-12-12T22:35:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46922024-12-12T22:35:46.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46932024-12-12T22:35:46.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46942024-12-12T22:35:46.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
46952024-12-12T22:35:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
46962024-12-12T22:35:46.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
46972024-12-12T22:35:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
46982024-12-12T22:35:46.129ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
46992024-12-12T22:35:46.129ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.282927ms iteration = 9 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
47002024-12-12T22:35:46.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.777554ms iteration = 9 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47012024-12-12T22:35:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1052 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 8aa1a52a-4eea-4706-bae7-fb167ed4619b response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
47022024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 4 reason = Timeout
47032024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 4 reason = Timeout
47042024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47052024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 10 reason = Timeout
47062024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47072024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47082024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 10 reason = Timeout
47092024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 4 reason = Timeout
47102024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
47112024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47122024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 4 reason = Timeout
47132024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 6 reason = Timeout
47142024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47152024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 4 reason = Timeout
47162024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 4 reason = Timeout
47172024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47182024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 4 reason = Timeout
47192024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
47202024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
47212024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 5 reason = Timeout
47222024-12-12T22:35:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
47232024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47242024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 4 reason = Timeout
47252024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
47262024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
47272024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 4 reason = Timeout
47282024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
47292024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47302024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47312024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47322024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
47332024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47342024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47352024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
47362024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
47372024-12-12T22:35:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
47382024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47392024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47402024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
47412024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 4 reason = Timeout
47422024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 4 reason = Timeout
47432024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
47442024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 4 reason = Timeout
47452024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
47462024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
47472024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 4 reason = Timeout
47482024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
47492024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
47502024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
47512024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
47522024-12-12T22:35:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
47532024-12-12T22:35:56.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47542024-12-12T22:35:56.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47552024-12-12T22:35:56.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
47562024-12-12T22:35:56.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
47572024-12-12T22:35:56.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47582024-12-12T22:35:56.110ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.871866ms iteration = 4 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
47592024-12-12T22:35:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
47602024-12-12T22:35:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
47612024-12-12T22:35:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
47622024-12-12T22:35:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
47632024-12-12T22:35:56.111ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47642024-12-12T22:35:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47652024-12-12T22:35:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
47662024-12-12T22:35:56.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
47672024-12-12T22:35:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
47682024-12-12T22:35:56.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47692024-12-12T22:35:56.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47702024-12-12T22:35:56.115ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3487, tv_nsec: 36765447 } })
47712024-12-12T22:35:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
47722024-12-12T22:35:56.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
47732024-12-12T22:35:56.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47742024-12-12T22:35:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47752024-12-12T22:35:56.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47762024-12-12T22:35:56.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47772024-12-12T22:35:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47782024-12-12T22:35:56.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47792024-12-12T22:35:56.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3487, tv_nsec: 39432869 } })
47802024-12-12T22:35:56.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
47812024-12-12T22:35:56.118ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.73513ms iteration = 4 status = {"errors":[],"garbage_collect_requested":[]}
47822024-12-12T22:35:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
47832024-12-12T22:35:56.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47842024-12-12T22:35:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47852024-12-12T22:35:56.121ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 16.125456ms iteration = 10 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
47862024-12-12T22:35:56.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
47872024-12-12T22:35:56.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
47882024-12-12T22:35:56.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3487, tv_nsec: 44482638 } })
47892024-12-12T22:35:56.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
47902024-12-12T22:35:56.123ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
47912024-12-12T22:35:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
47922024-12-12T22:35:56.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47932024-12-12T22:35:56.124ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
47942024-12-12T22:35:56.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
47952024-12-12T22:35:56.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
47962024-12-12T22:35:56.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
47972024-12-12T22:35:56.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
47982024-12-12T22:35:56.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
47992024-12-12T22:35:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
48002024-12-12T22:35:56.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
48012024-12-12T22:35:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
48022024-12-12T22:35:56.132ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
48032024-12-12T22:35:56.132ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.163154ms iteration = 4 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
48042024-12-12T22:35:56.144ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48052024-12-12T22:35:56.144ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
48062024-12-12T22:35:56.144ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48072024-12-12T22:35:56.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48082024-12-12T22:35:56.155ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
48092024-12-12T22:35:56.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
48102024-12-12T22:35:56.158ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48112024-12-12T22:35:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48122024-12-12T22:35:56.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.678814ms iteration = 4 status = {"errors":[],"records_set_to_done":[]}
48132024-12-12T22:35:56.162ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
48142024-12-12T22:35:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
48152024-12-12T22:35:56.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 59.977938ms iteration = 4 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
48162024-12-12T22:35:56.168ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48172024-12-12T22:35:56.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
48182024-12-12T22:35:56.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
48192024-12-12T22:35:56.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
48202024-12-12T22:35:56.182ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
48212024-12-12T22:35:56.182ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 77.537283ms iteration = 10 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
48222024-12-12T22:35:56.198ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48232024-12-12T22:35:56.198ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
48242024-12-12T22:35:56.198ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
48252024-12-12T22:35:56.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
48262024-12-12T22:35:56.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.199171ms iteration = 4 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
48272024-12-12T22:35:56.201ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
48282024-12-12T22:35:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
48292024-12-12T22:35:56.207ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48302024-12-12T22:35:56.207ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48312024-12-12T22:35:56.208ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4729a043-f9a4-4b38-a477-9b745b429dbb", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
48322024-12-12T22:35:56.208ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48332024-12-12T22:35:56.209ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48342024-12-12T22:35:56.211ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
48352024-12-12T22:35:56.211ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48362024-12-12T22:35:56.212ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "51c2e06f-3884-44f1-9edc-34aa62d5e8eb", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
48372024-12-12T22:35:56.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48382024-12-12T22:35:56.213ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
48392024-12-12T22:35:56.225ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
48402024-12-12T22:35:56.225ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
48412024-12-12T22:35:56.225ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "aa1b080e-daec-4a1d-9f47-fc4c3b5794de", "content-length": "26", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
48422024-12-12T22:35:56.225ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
48432024-12-12T22:35:56.226ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 120.837263ms iteration = 6 status = {"physical_disks_added":0}
48442024-12-12T22:35:56.227ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
48452024-12-12T22:35:56.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48462024-12-12T22:35:56.238ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48472024-12-12T22:35:56.262ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48482024-12-12T22:35:56.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48492024-12-12T22:35:56.310ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
48502024-12-12T22:35:56.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
48512024-12-12T22:35:56.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "d77edf31-4197-4cf5-a0f4-d419766b2117", "content-length": "372", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
48522024-12-12T22:35:56.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48532024-12-12T22:35:56.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48542024-12-12T22:35:56.315ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48552024-12-12T22:35:56.315ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48562024-12-12T22:35:56.316ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48572024-12-12T22:35:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
48582024-12-12T22:35:56.319ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
48592024-12-12T22:35:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
48602024-12-12T22:35:56.321ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 216.462942ms iteration = 4 status = 0
48612024-12-12T22:35:56.327ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 221.99268ms iteration = 4 status = {}
48622024-12-12T22:35:56.342ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 235.452104ms iteration = 4 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
48632024-12-12T22:35:56.349ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
48642024-12-12T22:35:56.349ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
48652024-12-12T22:35:56.349ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 244.073704ms iteration = 4 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
48662024-12-12T22:35:56.357ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
48672024-12-12T22:35:56.357ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
48682024-12-12T22:35:56.357ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "7b50a1f8-a44d-44b8-b87a-e1764de308f5", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
48692024-12-12T22:35:56.357ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48702024-12-12T22:35:56.358ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48712024-12-12T22:35:56.360ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48722024-12-12T22:35:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48732024-12-12T22:35:56.394ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
48742024-12-12T22:35:56.394ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "4637eb5a-f0a6-46b1-949b-cb208a5d3cf1", "content-length": "1", "date": "Thu, 12 Dec 2024 22:35:55 GMT"} })
48752024-12-12T22:35:56.395ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
48762024-12-12T22:35:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
48772024-12-12T22:35:56.398ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 292.717359ms iteration = 4 status = null
48782024-12-12T22:35:56.407ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48792024-12-12T22:35:56.407ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48802024-12-12T22:35:56.408ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48812024-12-12T22:35:56.410ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48822024-12-12T22:35:56.410ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48832024-12-12T22:35:56.410ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48842024-12-12T22:35:56.441ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
48852024-12-12T22:35:56.442ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
48862024-12-12T22:35:56.442ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
48872024-12-12T22:35:56.443ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
48882024-12-12T22:35:56.456ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48892024-12-12T22:35:56.456ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48902024-12-12T22:35:56.458ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
48912024-12-12T22:35:56.458ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
48922024-12-12T22:35:56.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
48932024-12-12T22:35:56.467ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
48942024-12-12T22:35:56.467ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
48952024-12-12T22:35:56.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
48962024-12-12T22:35:56.468ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "860b39f0-728e-4ca5-b0d5-84894f6f440c", "content-length": "134", "date": "Thu, 12 Dec 2024 22:35:55 GMT"} })
48972024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
48982024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
48992024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
49002024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
49012024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49022024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49032024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49042024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49052024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
49062024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
49072024-12-12T22:35:56.468ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
49082024-12-12T22:35:56.468ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49092024-12-12T22:35:56.468ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49102024-12-12T22:35:56.471ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
49112024-12-12T22:35:56.471ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "0d929c38-7d1d-4d51-95d7-b4452ebf881b", "content-length": "2", "date": "Thu, 12 Dec 2024 22:35:55 GMT"} })
49122024-12-12T22:35:56.471ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
49132024-12-12T22:35:56.471ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "7c4fe371-a33f-4484-be3a-c54a0430b273", "content-length": "52", "date": "Thu, 12 Dec 2024 22:35:55 GMT"} })
49142024-12-12T22:35:56.471ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
49152024-12-12T22:35:56.471ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
49162024-12-12T22:35:56.472ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
49172024-12-12T22:35:56.472ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
49182024-12-12T22:35:56.543ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
49192024-12-12T22:35:56.561ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "380d0d79-dfc2-4371-a221-d57c8747866a", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
49202024-12-12T22:35:56.561ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
49212024-12-12T22:35:56.561ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
49222024-12-12T22:35:56.561ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1aff6a16-f761-4a63-9cd2-3cfd70d85b06", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
49232024-12-12T22:35:56.563ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 457.498765ms iteration = 5 status = {}
49242024-12-12T22:35:56.563ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2594bcb8-dd75-4c37-94cd-32544b145aaa", "content-length": "682", "date": "Thu, 12 Dec 2024 22:35:56 GMT"} })
49252024-12-12T22:35:56.563ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "98c26541-9e9a-48da-923d-93992127b8b6", "content-length": "691", "date": "Thu, 12 Dec 2024 22:35:55 GMT"} })
49262024-12-12T22:35:56.563ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
49272024-12-12T22:35:56.563ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
49282024-12-12T22:35:56.563ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
49292024-12-12T22:35:56.563ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49302024-12-12T22:35:56.563ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49312024-12-12T22:35:56.564ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 458.651538ms iteration = 4 status = {}
49322024-12-12T22:35:56.567ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49332024-12-12T22:35:56.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49342024-12-12T22:35:56.572ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49352024-12-12T22:35:56.572ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49362024-12-12T22:35:56.574ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49372024-12-12T22:35:56.575ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
49382024-12-12T22:35:56.581ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 476.550989ms iteration = 4 status = {}
49392024-12-12T22:35:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1153 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 79a81eb1-7145-4541-8a42-ee057c0ebcac response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
49402024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 11 reason = Timeout
49412024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49422024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 11 reason = Timeout
49432024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49442024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49452024-12-12T22:36:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49462024-12-12T22:36:06.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49472024-12-12T22:36:06.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49482024-12-12T22:36:06.133ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49492024-12-12T22:36:06.136ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49502024-12-12T22:36:06.136ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49512024-12-12T22:36:06.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49522024-12-12T22:36:06.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49532024-12-12T22:36:06.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49542024-12-12T22:36:06.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49552024-12-12T22:36:06.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
49562024-12-12T22:36:06.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49572024-12-12T22:36:06.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49582024-12-12T22:36:06.152ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
49592024-12-12T22:36:06.152ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.826319ms iteration = 11 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
49602024-12-12T22:36:06.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 55.827636ms iteration = 11 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49612024-12-12T22:36:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1246 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 78acd6c6-ce69-4fb1-9ca2-49772f423789 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
49622024-12-12T22:36:16.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 12 reason = Timeout
49632024-12-12T22:36:16.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49642024-12-12T22:36:16.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 12 reason = Timeout
49652024-12-12T22:36:16.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49662024-12-12T22:36:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49672024-12-12T22:36:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49682024-12-12T22:36:16.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
49692024-12-12T22:36:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
49702024-12-12T22:36:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49712024-12-12T22:36:16.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.350125ms iteration = 12 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
49722024-12-12T22:36:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
49732024-12-12T22:36:16.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49742024-12-12T22:36:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49752024-12-12T22:36:16.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49762024-12-12T22:36:16.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49772024-12-12T22:36:16.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
49782024-12-12T22:36:16.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
49792024-12-12T22:36:16.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
49802024-12-12T22:36:16.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
49812024-12-12T22:36:16.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
49822024-12-12T22:36:16.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.226676ms iteration = 12 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
49832024-12-12T22:36:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1058 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = fff1af45-371c-47e4-a043-b27b6c9dee80 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
49842024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 5 reason = Timeout
49852024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
49862024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 5 reason = Timeout
49872024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 3 reason = Timeout
49882024-12-12T22:36:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
49892024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 3 reason = Timeout
49902024-12-12T22:36:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:26:26.105329752 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
49912024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
49922024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 4 reason = Timeout
49932024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 3 reason = Timeout
49942024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
49952024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
49962024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
49972024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 6 reason = Timeout
49982024-12-12T22:36:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
49992024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
50002024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 4 reason = Timeout
50012024-12-12T22:36:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
50022024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 13 reason = Timeout
50032024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 22.12\u{b5}s iteration = 4 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
50042024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 5 reason = Timeout
50052024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50062024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 4 reason = Timeout
50072024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 4 reason = Timeout
50082024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
50092024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50102024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 4 reason = Timeout
50112024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 5 reason = Timeout
50122024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
50132024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 5 reason = Timeout
50142024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
50152024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 5 reason = Timeout
50162024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
50172024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
50182024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 13 reason = Timeout
50192024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
50202024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 7 reason = Timeout
50212024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
50222024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 5 reason = Timeout
50232024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
50242024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 4 reason = Timeout
50252024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
50262024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 3 reason = Timeout
50272024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
50282024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
50292024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 5 reason = Timeout
50302024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
50312024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 5 reason = Timeout
50322024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 5 reason = Timeout
50332024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
50342024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
50352024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 5 reason = Timeout
50362024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
50372024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 5 reason = Timeout
50382024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 5 reason = Timeout
50392024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
50402024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 5 reason = Timeout
50412024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
50422024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 3 reason = Timeout
50432024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
50442024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50452024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 5 reason = Timeout
50462024-12-12T22:36:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50472024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
50482024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50492024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50502024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
50512024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
50522024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
50532024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50542024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
50552024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
50562024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
50572024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
50582024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
50592024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
50602024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
50612024-12-12T22:36:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3517, tv_nsec: 27825154 } })
50622024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
50632024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
50642024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
50652024-12-12T22:36:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3517, tv_nsec: 27890496 } })
50662024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
50672024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
50682024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
50692024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
50702024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
50712024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
50722024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
50732024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.427528ms iteration = 4 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
50742024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
50752024-12-12T22:36:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.482869ms iteration = 4 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
50762024-12-12T22:36:26.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50772024-12-12T22:36:26.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50782024-12-12T22:36:26.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50792024-12-12T22:36:26.110ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50802024-12-12T22:36:26.111ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:26:26.105329752 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
50812024-12-12T22:36:26.111ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.741283ms iteration = 3 status = {"expiration":"2024-12-12T22:26:26.105329752Z","pruned":[]}
50822024-12-12T22:36:26.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
50832024-12-12T22:36:26.111ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
50842024-12-12T22:36:26.111ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.965817ms iteration = 5 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
50852024-12-12T22:36:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
50862024-12-12T22:36:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
50872024-12-12T22:36:26.112ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
50882024-12-12T22:36:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
50892024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
50902024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
50912024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
50922024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
50932024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
50942024-12-12T22:36:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
50952024-12-12T22:36:26.114ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
50962024-12-12T22:36:26.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
50972024-12-12T22:36:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
50982024-12-12T22:36:26.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
50992024-12-12T22:36:26.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51002024-12-12T22:36:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51012024-12-12T22:36:26.116ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
51022024-12-12T22:36:26.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3517, tv_nsec: 38110916 } })
51032024-12-12T22:36:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
51042024-12-12T22:36:26.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3517, tv_nsec: 38346861 } })
51052024-12-12T22:36:26.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
51062024-12-12T22:36:26.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
51072024-12-12T22:36:26.118ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51082024-12-12T22:36:26.118ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51092024-12-12T22:36:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51102024-12-12T22:36:26.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51112024-12-12T22:36:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51122024-12-12T22:36:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
51132024-12-12T22:36:26.121ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51142024-12-12T22:36:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51152024-12-12T22:36:26.124ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
51162024-12-12T22:36:26.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
51172024-12-12T22:36:26.128ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.053163ms iteration = 3 status = {"errors":[],"found_port_ok":[]}
51182024-12-12T22:36:26.129ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51192024-12-12T22:36:26.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51202024-12-12T22:36:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51212024-12-12T22:36:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51222024-12-12T22:36:26.130ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3517, tv_nsec: 52299005 } })
51232024-12-12T22:36:26.131ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
51242024-12-12T22:36:26.132ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51252024-12-12T22:36:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51262024-12-12T22:36:26.133ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51272024-12-12T22:36:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51282024-12-12T22:36:26.143ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
51292024-12-12T22:36:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
51302024-12-12T22:36:26.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51312024-12-12T22:36:26.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
51322024-12-12T22:36:26.153ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
51332024-12-12T22:36:26.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
51342024-12-12T22:36:26.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51352024-12-12T22:36:26.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
51362024-12-12T22:36:26.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
51372024-12-12T22:36:26.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
51382024-12-12T22:36:26.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51392024-12-12T22:36:26.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
51402024-12-12T22:36:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
51412024-12-12T22:36:26.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.418953ms iteration = 5 status = {"errors":[],"records_set_to_done":[]}
51422024-12-12T22:36:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
51432024-12-12T22:36:26.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
51442024-12-12T22:36:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
51452024-12-12T22:36:26.178ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51462024-12-12T22:36:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51472024-12-12T22:36:26.178ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
51482024-12-12T22:36:26.178ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
51492024-12-12T22:36:26.178ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.30483ms iteration = 3 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
51502024-12-12T22:36:26.179ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51512024-12-12T22:36:26.179ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
51522024-12-12T22:36:26.179ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51532024-12-12T22:36:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51542024-12-12T22:36:26.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 74.219368ms iteration = 5 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
51552024-12-12T22:36:26.180ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 74.782129ms iteration = 5 status = {"errors":[],"garbage_collect_requested":[]}
51562024-12-12T22:36:26.181ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
51572024-12-12T22:36:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
51582024-12-12T22:36:26.181ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
51592024-12-12T22:36:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
51602024-12-12T22:36:26.182ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51612024-12-12T22:36:26.182ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
51622024-12-12T22:36:26.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
51632024-12-12T22:36:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
51642024-12-12T22:36:26.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.40265ms iteration = 5 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
51652024-12-12T22:36:26.185ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
51662024-12-12T22:36:26.185ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
51672024-12-12T22:36:26.185ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 79.726426ms iteration = 5 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
51682024-12-12T22:36:26.186ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51692024-12-12T22:36:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51702024-12-12T22:36:26.190ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
51712024-12-12T22:36:26.190ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
51722024-12-12T22:36:26.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
51732024-12-12T22:36:26.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51742024-12-12T22:36:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51752024-12-12T22:36:26.191ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51762024-12-12T22:36:26.192ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
51772024-12-12T22:36:26.192ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 86.694493ms iteration = 13 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
51782024-12-12T22:36:26.192ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51792024-12-12T22:36:26.193ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
51802024-12-12T22:36:26.193ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
51812024-12-12T22:36:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
51822024-12-12T22:36:26.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51832024-12-12T22:36:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51842024-12-12T22:36:26.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51852024-12-12T22:36:26.195ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
51862024-12-12T22:36:26.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
51872024-12-12T22:36:26.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
51882024-12-12T22:36:26.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
51892024-12-12T22:36:26.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
51902024-12-12T22:36:26.199ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
51912024-12-12T22:36:26.199ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
51922024-12-12T22:36:26.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
51932024-12-12T22:36:26.200ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 95.17608ms iteration = 13 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
51942024-12-12T22:36:26.201ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
51952024-12-12T22:36:26.201ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
51962024-12-12T22:36:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 95.957925ms iteration = 3 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
51972024-12-12T22:36:26.203ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
51982024-12-12T22:36:26.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
51992024-12-12T22:36:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
52002024-12-12T22:36:26.206ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52012024-12-12T22:36:26.227ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52022024-12-12T22:36:26.227ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
52032024-12-12T22:36:26.227ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 121.721931ms iteration = 5 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
52042024-12-12T22:36:26.227ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 121.671809ms iteration = 5 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
52052024-12-12T22:36:26.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52062024-12-12T22:36:26.239ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
52072024-12-12T22:36:26.239ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
52082024-12-12T22:36:26.239ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
52092024-12-12T22:36:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52102024-12-12T22:36:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52112024-12-12T22:36:26.259ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52122024-12-12T22:36:26.259ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52132024-12-12T22:36:26.259ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "47019532-841b-44c1-bbaa-be58283df5f1", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
52142024-12-12T22:36:26.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52152024-12-12T22:36:26.260ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52162024-12-12T22:36:26.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52172024-12-12T22:36:26.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52182024-12-12T22:36:26.295ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
52192024-12-12T22:36:26.295ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52202024-12-12T22:36:26.295ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cced924b-40c1-408b-87b4-c54b8637f3c5", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
52212024-12-12T22:36:26.295ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52222024-12-12T22:36:26.295ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 189.90078ms iteration = 7 status = {"physical_disks_added":0}
52232024-12-12T22:36:26.296ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
52242024-12-12T22:36:26.306ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
52252024-12-12T22:36:26.306ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
52262024-12-12T22:36:26.306ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "276437dd-0831-46ef-887b-9812f2d4fc56", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
52272024-12-12T22:36:26.307ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
52282024-12-12T22:36:26.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
52292024-12-12T22:36:26.392ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
52302024-12-12T22:36:26.393ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
52312024-12-12T22:36:26.395ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52322024-12-12T22:36:26.395ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
52332024-12-12T22:36:26.396ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52342024-12-12T22:36:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
52352024-12-12T22:36:26.398ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
52362024-12-12T22:36:26.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
52372024-12-12T22:36:26.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
52382024-12-12T22:36:26.398ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
52392024-12-12T22:36:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
52402024-12-12T22:36:26.400ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 295.30666ms iteration = 5 status = 0
52412024-12-12T22:36:26.421ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
52422024-12-12T22:36:26.421ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "f62c6ff8-3e8d-4dff-ac2f-18852b2c3217", "content-length": "1", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
52432024-12-12T22:36:26.423ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
52442024-12-12T22:36:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
52452024-12-12T22:36:26.425ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 319.993065ms iteration = 5 status = null
52462024-12-12T22:36:26.426ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
52472024-12-12T22:36:26.428ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
52482024-12-12T22:36:26.428ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
52492024-12-12T22:36:26.428ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52502024-12-12T22:36:26.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52512024-12-12T22:36:26.429ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52522024-12-12T22:36:26.431ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52532024-12-12T22:36:26.431ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52542024-12-12T22:36:26.431ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52552024-12-12T22:36:26.432ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52562024-12-12T22:36:26.433ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52572024-12-12T22:36:26.435ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
52582024-12-12T22:36:26.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
52592024-12-12T22:36:26.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
52602024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52612024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52622024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fbb216b8-50ae-4347-9452-462473250fe7", "content-length": "372", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
52632024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52642024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52652024-12-12T22:36:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52662024-12-12T22:36:26.454ZINFOnexus (BackgroundTasks): found Silo/DNS/TLS config (changed) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) } file = nexus/src/app/background/tasks/external_endpoints.rs:94
52672024-12-12T22:36:26.454ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 348.697718ms iteration = 4 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
52682024-12-12T22:36:26.459ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52692024-12-12T22:36:26.462ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
52702024-12-12T22:36:26.462ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
52712024-12-12T22:36:26.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
52722024-12-12T22:36:26.464ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 359.422769ms iteration = 5 status = {}
52732024-12-12T22:36:26.465ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
52742024-12-12T22:36:26.465ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
52752024-12-12T22:36:26.465ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
52762024-12-12T22:36:26.465ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 359.723975ms iteration = 4 status = {"generation":2}
52772024-12-12T22:36:26.468ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
52782024-12-12T22:36:26.468ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
52792024-12-12T22:36:26.468ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52802024-12-12T22:36:26.469ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52812024-12-12T22:36:26.470ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
52822024-12-12T22:36:26.473ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
52832024-12-12T22:36:26.473ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
52842024-12-12T22:36:26.473ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
52852024-12-12T22:36:26.475ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
52862024-12-12T22:36:26.475ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
52872024-12-12T22:36:26.475ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
52882024-12-12T22:36:26.475ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 370.229571ms iteration = 4 status = {"generation":1}
52892024-12-12T22:36:26.479ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
52902024-12-12T22:36:26.479ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
52912024-12-12T22:36:26.480ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5639c58d-e74c-4df2-bac6-66a41955577b", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
52922024-12-12T22:36:26.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52932024-12-12T22:36:26.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52942024-12-12T22:36:26.482ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52952024-12-12T22:36:26.483ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52962024-12-12T22:36:26.485ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
52972024-12-12T22:36:26.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
52982024-12-12T22:36:26.490ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
52992024-12-12T22:36:26.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
53002024-12-12T22:36:26.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1aca3998-c8e7-4c70-9392-4fdba309d67c", "date": "Thu, 12 Dec 2024 22:36:25 GMT"} })
53012024-12-12T22:36:26.491ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.42302ms iteration = 6 status = {}
53022024-12-12T22:36:26.493ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
53032024-12-12T22:36:26.493ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 388.270976ms iteration = 3 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
53042024-12-12T22:36:26.625ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
53052024-12-12T22:36:26.625ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "eabbe26a-ae4a-45a6-a33f-cae1afbe60ef", "content-length": "691", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53062024-12-12T22:36:26.625ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
53072024-12-12T22:36:26.625ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
53082024-12-12T22:36:26.625ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
53092024-12-12T22:36:26.626ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 521.329199ms iteration = 5 status = {}
53102024-12-12T22:36:26.638ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
53112024-12-12T22:36:26.668ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
53122024-12-12T22:36:26.668ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "63db014e-6ae2-440d-ad6c-f22d012851b0", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53132024-12-12T22:36:26.668ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53142024-12-12T22:36:26.670ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "1a5cef7f-1177-4449-a6aa-b2f5a219430e", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53152024-12-12T22:36:26.670ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53162024-12-12T22:36:26.671ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
53172024-12-12T22:36:26.671ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 566.149559ms iteration = 5 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
53182024-12-12T22:36:26.677ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53192024-12-12T22:36:26.677ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53202024-12-12T22:36:26.679ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
53212024-12-12T22:36:26.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53222024-12-12T22:36:26.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53232024-12-12T22:36:26.698ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
53242024-12-12T22:36:26.699ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ebdb5e8a-200c-45d8-8263-dc1e7227f369", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53252024-12-12T22:36:26.699ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53262024-12-12T22:36:26.700ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5bc6a0a5-2693-440b-a246-2b58b2dd4c71", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53272024-12-12T22:36:26.700ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53282024-12-12T22:36:26.701ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "e2fd050e-4d76-4a33-a1ea-dbc0e5b481cd", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53292024-12-12T22:36:26.701ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53302024-12-12T22:36:26.703ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
53312024-12-12T22:36:26.703ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 598.040326ms iteration = 5 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
53322024-12-12T22:36:26.801ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
53332024-12-12T22:36:26.801ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "ff850643-fc18-48d3-ba6d-d68769b353e7", "content-length": "134", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53342024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
53352024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
53362024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
53372024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
53382024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53392024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53402024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53412024-12-12T22:36:26.801ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53422024-12-12T22:36:26.802ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
53432024-12-12T22:36:26.802ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
53442024-12-12T22:36:26.802ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
53452024-12-12T22:36:26.802ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53462024-12-12T22:36:26.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53472024-12-12T22:36:26.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
53482024-12-12T22:36:26.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8f803d8-52a6-4ec7-bcdd-a72b8ae8511f", "content-length": "2", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53492024-12-12T22:36:26.804ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
53502024-12-12T22:36:26.804ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "2b1175db-b995-4081-81d2-7aa5fe1fd6f5", "content-length": "52", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53512024-12-12T22:36:26.804ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
53522024-12-12T22:36:26.804ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
53532024-12-12T22:36:26.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e6064f94-deac-4f02-9fbb-0f53a67a2069", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53542024-12-12T22:36:26.896ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
53552024-12-12T22:36:26.896ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
53562024-12-12T22:36:26.896ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "2fadc6ff-482f-48b7-aae6-5d5907d131dd", "content-length": "682", "date": "Thu, 12 Dec 2024 22:36:26 GMT"} })
53572024-12-12T22:36:26.896ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53582024-12-12T22:36:26.896ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53592024-12-12T22:36:26.901ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53602024-12-12T22:36:26.902ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53612024-12-12T22:36:26.905ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53622024-12-12T22:36:26.905ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53632024-12-12T22:36:26.907ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
53642024-12-12T22:36:26.908ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
53652024-12-12T22:36:26.914ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 809.684743ms iteration = 5 status = {}
53662024-12-12T22:36:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1018 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 42907ffa-a147-4afd-9828-8e3323ac22d8 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
53672024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 14 reason = Timeout
53682024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53692024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 14 reason = Timeout
53702024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53712024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53722024-12-12T22:36:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53732024-12-12T22:36:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53742024-12-12T22:36:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53752024-12-12T22:36:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53762024-12-12T22:36:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53772024-12-12T22:36:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53782024-12-12T22:36:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53792024-12-12T22:36:36.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53802024-12-12T22:36:36.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
53812024-12-12T22:36:36.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53822024-12-12T22:36:36.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53832024-12-12T22:36:36.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53842024-12-12T22:36:36.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53852024-12-12T22:36:36.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.498909ms iteration = 14 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
53862024-12-12T22:36:36.245ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
53872024-12-12T22:36:36.245ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 140.52458ms iteration = 14 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
53882024-12-12T22:36:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1105 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = fa05a16e-919f-4be3-b3d4-dd93a6c4e03b response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
53892024-12-12T22:36:46.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 15 reason = Timeout
53902024-12-12T22:36:46.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
53912024-12-12T22:36:46.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 15 reason = Timeout
53922024-12-12T22:36:46.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53932024-12-12T22:36:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
53942024-12-12T22:36:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53952024-12-12T22:36:46.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
53962024-12-12T22:36:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
53972024-12-12T22:36:46.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
53982024-12-12T22:36:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
53992024-12-12T22:36:46.141ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54002024-12-12T22:36:46.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54012024-12-12T22:36:46.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54022024-12-12T22:36:46.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54032024-12-12T22:36:46.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54042024-12-12T22:36:46.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
54052024-12-12T22:36:46.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54062024-12-12T22:36:46.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54072024-12-12T22:36:46.155ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
54082024-12-12T22:36:46.155ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 50.175866ms iteration = 15 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
54092024-12-12T22:36:46.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.740552ms iteration = 15 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
54102024-12-12T22:36:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1070 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 18f8cca4-49b6-4641-b709-485b5ca62409 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
54112024-12-12T22:36:56.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 6 reason = Timeout
54122024-12-12T22:36:56.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54132024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 6 reason = Timeout
54142024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
54152024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 16 reason = Timeout
54162024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
54172024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 6 reason = Timeout
54182024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54192024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 6 reason = Timeout
54202024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 6 reason = Timeout
54212024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
54222024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
54232024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 7 reason = Timeout
54242024-12-12T22:36:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
54252024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 16 reason = Timeout
54262024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54272024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
54282024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 6 reason = Timeout
54292024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54302024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 6 reason = Timeout
54312024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
54322024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 6 reason = Timeout
54332024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54342024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 6 reason = Timeout
54352024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
54362024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 8 reason = Timeout
54372024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54382024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54392024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
54402024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54412024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
54422024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
54432024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
54442024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
54452024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54462024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54472024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54482024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54492024-12-12T22:36:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
54502024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 6 reason = Timeout
54512024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 6 reason = Timeout
54522024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
54532024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
54542024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 6 reason = Timeout
54552024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54562024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 6 reason = Timeout
54572024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
54582024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54592024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
54602024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
54612024-12-12T22:36:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
54622024-12-12T22:36:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54632024-12-12T22:36:56.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54642024-12-12T22:36:56.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.986948ms iteration = 6 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
54652024-12-12T22:36:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3547, tv_nsec: 30719505 } })
54662024-12-12T22:36:56.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
54672024-12-12T22:36:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
54682024-12-12T22:36:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
54692024-12-12T22:36:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
54702024-12-12T22:36:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
54712024-12-12T22:36:56.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54722024-12-12T22:36:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54732024-12-12T22:36:56.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54742024-12-12T22:36:56.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3547, tv_nsec: 34692393 } })
54752024-12-12T22:36:56.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
54762024-12-12T22:36:56.113ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54772024-12-12T22:36:56.113ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54782024-12-12T22:36:56.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54792024-12-12T22:36:56.115ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54802024-12-12T22:36:56.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
54812024-12-12T22:36:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
54822024-12-12T22:36:56.116ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
54832024-12-12T22:36:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
54842024-12-12T22:36:56.116ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
54852024-12-12T22:36:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
54862024-12-12T22:36:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
54872024-12-12T22:36:56.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
54882024-12-12T22:36:56.118ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
54892024-12-12T22:36:56.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
54902024-12-12T22:36:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
54912024-12-12T22:36:56.119ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
54922024-12-12T22:36:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
54932024-12-12T22:36:56.123ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
54942024-12-12T22:36:56.123ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
54952024-12-12T22:36:56.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3547, tv_nsec: 45502236 } })
54962024-12-12T22:36:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
54972024-12-12T22:36:56.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
54982024-12-12T22:36:56.125ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
54992024-12-12T22:36:56.125ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55002024-12-12T22:36:56.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55012024-12-12T22:36:56.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55022024-12-12T22:36:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55032024-12-12T22:36:56.136ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55042024-12-12T22:36:56.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55052024-12-12T22:36:56.142ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55062024-12-12T22:36:56.142ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
55072024-12-12T22:36:56.142ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55082024-12-12T22:36:56.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55092024-12-12T22:36:56.146ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
55102024-12-12T22:36:56.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
55112024-12-12T22:36:56.168ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
55122024-12-12T22:36:56.168ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 63.831304ms iteration = 6 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
55132024-12-12T22:36:56.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 63.113419ms iteration = 6 status = {"errors":[],"records_set_to_done":[]}
55142024-12-12T22:36:56.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
55152024-12-12T22:36:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
55162024-12-12T22:36:56.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
55172024-12-12T22:36:56.170ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55182024-12-12T22:36:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55192024-12-12T22:36:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
55202024-12-12T22:36:56.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 66.307143ms iteration = 6 status = {"errors":[],"garbage_collect_requested":[]}
55212024-12-12T22:36:56.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55222024-12-12T22:36:56.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55232024-12-12T22:36:56.174ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55242024-12-12T22:36:56.178ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55252024-12-12T22:36:56.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
55262024-12-12T22:36:56.178ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
55272024-12-12T22:36:56.178ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55282024-12-12T22:36:56.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
55292024-12-12T22:36:56.180ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
55302024-12-12T22:36:56.180ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
55312024-12-12T22:36:56.180ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
55322024-12-12T22:36:56.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
55332024-12-12T22:36:56.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
55342024-12-12T22:36:56.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
55352024-12-12T22:36:56.182ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
55362024-12-12T22:36:56.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
55372024-12-12T22:36:56.183ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 77.940811ms iteration = 6 status = 0
55382024-12-12T22:36:56.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 77.433471ms iteration = 6 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
55392024-12-12T22:36:56.187ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55402024-12-12T22:36:56.187ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55412024-12-12T22:36:56.187ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "926b0ad0-0d76-4db7-aa51-1f6fdff8b8d4", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
55422024-12-12T22:36:56.187ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55432024-12-12T22:36:56.189ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55442024-12-12T22:36:56.189ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
55452024-12-12T22:36:56.189ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
55462024-12-12T22:36:56.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
55472024-12-12T22:36:56.190ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55482024-12-12T22:36:56.194ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
55492024-12-12T22:36:56.194ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 89.910855ms iteration = 16 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
55502024-12-12T22:36:56.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 89.952077ms iteration = 16 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
55512024-12-12T22:36:56.196ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
55522024-12-12T22:36:56.196ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55532024-12-12T22:36:56.196ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f87717c-ff0d-459a-a559-ae4f454248b1", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
55542024-12-12T22:36:56.196ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55552024-12-12T22:36:56.198ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
55562024-12-12T22:36:56.203ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 98.896422ms iteration = 6 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
55572024-12-12T22:36:56.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 98.726729ms iteration = 6 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
55582024-12-12T22:36:56.224ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
55592024-12-12T22:36:56.224ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
55602024-12-12T22:36:56.224ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 119.197011ms iteration = 6 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
55612024-12-12T22:36:56.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
55622024-12-12T22:36:56.229ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
55632024-12-12T22:36:56.229ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "4e611307-d19e-4192-892f-cae675f138e0", "content-length": "26", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
55642024-12-12T22:36:56.229ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
55652024-12-12T22:36:56.230ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
55662024-12-12T22:36:56.235ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55672024-12-12T22:36:56.235ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55682024-12-12T22:36:56.274ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 169.788825ms iteration = 8 status = {"physical_disks_added":0}
55692024-12-12T22:36:56.287ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 182.341091ms iteration = 6 status = {}
55702024-12-12T22:36:56.303ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
55712024-12-12T22:36:56.303ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "fa4a1ba7-8eb1-43ee-8ad6-1d4028d56642", "content-length": "1", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
55722024-12-12T22:36:56.305ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
55732024-12-12T22:36:56.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
55742024-12-12T22:36:56.307ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 202.606839ms iteration = 6 status = null
55752024-12-12T22:36:56.308ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
55762024-12-12T22:36:56.308ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
55772024-12-12T22:36:56.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55782024-12-12T22:36:56.335ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55792024-12-12T22:36:56.363ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55802024-12-12T22:36:56.365ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
55812024-12-12T22:36:56.365ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
55822024-12-12T22:36:56.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
55832024-12-12T22:36:56.369ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55842024-12-12T22:36:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55852024-12-12T22:36:56.376ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc50325-3704-4971-b129-796c2de11a66", "content-length": "372", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
55862024-12-12T22:36:56.376ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55872024-12-12T22:36:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55882024-12-12T22:36:56.381ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
55892024-12-12T22:36:56.381ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
55902024-12-12T22:36:56.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
55912024-12-12T22:36:56.394ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
55922024-12-12T22:36:56.394ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
55932024-12-12T22:36:56.394ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "e552d8fc-8747-480b-bd38-96fdf5c43a2b", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
55942024-12-12T22:36:56.394ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55952024-12-12T22:36:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55962024-12-12T22:36:56.396ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
55972024-12-12T22:36:56.397ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
55982024-12-12T22:36:56.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
55992024-12-12T22:36:56.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
56002024-12-12T22:36:56.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
56012024-12-12T22:36:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
56022024-12-12T22:36:56.399ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
56032024-12-12T22:36:56.400ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
56042024-12-12T22:36:56.404ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
56052024-12-12T22:36:56.404ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
56062024-12-12T22:36:56.404ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "1dd7cfe9-f9c7-4b40-87d9-fe1189e43bf1", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
56072024-12-12T22:36:56.405ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 300.853608ms iteration = 7 status = {}
56082024-12-12T22:36:56.432ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
56092024-12-12T22:36:56.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0d19840-2cc2-4b70-a7d5-fa2cf1c45d0a", "content-length": "691", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
56102024-12-12T22:36:56.432ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
56112024-12-12T22:36:56.432ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
56122024-12-12T22:36:56.432ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
56132024-12-12T22:36:56.434ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 329.248387ms iteration = 6 status = {}
56142024-12-12T22:36:56.501ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
56152024-12-12T22:36:56.502ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "00378cff-8dde-4437-887f-be75a383276c", "content-length": "134", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
56162024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
56172024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
56182024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
56192024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
56202024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56212024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56222024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56232024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56242024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
56252024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
56262024-12-12T22:36:56.502ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
56272024-12-12T22:36:56.502ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56282024-12-12T22:36:56.503ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56292024-12-12T22:36:56.505ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
56302024-12-12T22:36:56.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "c8df8c0f-f757-4d55-9b9e-e8e1211a5dd7", "content-length": "2", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
56312024-12-12T22:36:56.505ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
56322024-12-12T22:36:56.505ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "97a72827-67e0-4ec2-a6f6-8d0969d46636", "content-length": "52", "date": "Thu, 12 Dec 2024 22:36:55 GMT"} })
56332024-12-12T22:36:56.505ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
56342024-12-12T22:36:56.505ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
56352024-12-12T22:36:56.604ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "57729f42-0765-4edb-8aa5-bf3d98067c38", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
56362024-12-12T22:36:56.604ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
56372024-12-12T22:36:56.604ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
56382024-12-12T22:36:56.607ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "90b49e9a-dac2-4ed2-8a82-4475c7912f31", "content-length": "682", "date": "Thu, 12 Dec 2024 22:36:56 GMT"} })
56392024-12-12T22:36:56.607ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56402024-12-12T22:36:56.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56412024-12-12T22:36:56.611ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56422024-12-12T22:36:56.612ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56432024-12-12T22:36:56.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56442024-12-12T22:36:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56452024-12-12T22:36:56.617ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
56462024-12-12T22:36:56.617ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
56472024-12-12T22:36:56.624ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 519.3805ms iteration = 6 status = {}
56482024-12-12T22:36:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1069 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 32fd3d6e-7b13-4b0f-97cf-fdae353fb92e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
56492024-12-12T22:37:03.429ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:35640
56502024-12-12T22:37:03.429ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35640 req_id = 90451b4d-eacc-42cc-a75f-bfcb31cf647e roles = RoleSet { roles: {} } uri = /metrics/producers
56512024-12-12T22:37:03.429ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35640 req_id = 90451b4d-eacc-42cc-a75f-bfcb31cf647e resource = Database result = Ok(()) uri = /metrics/producers
56522024-12-12T22:37:03.467ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = bb9dca28-dea1-4105-b015-9af4a5ccce7e
56532024-12-12T22:37:03.467ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38584 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:35640 req_id = 90451b4d-eacc-42cc-a75f-bfcb31cf647e response_code = 201 uri = /metrics/producers
56542024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 17 reason = Timeout
56552024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56562024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 17 reason = Timeout
56572024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56582024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56592024-12-12T22:37:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56602024-12-12T22:37:06.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56612024-12-12T22:37:06.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56622024-12-12T22:37:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56632024-12-12T22:37:06.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.154502ms iteration = 17 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
56642024-12-12T22:37:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56652024-12-12T22:37:06.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56662024-12-12T22:37:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56672024-12-12T22:37:06.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56682024-12-12T22:37:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56692024-12-12T22:37:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56702024-12-12T22:37:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
56712024-12-12T22:37:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56722024-12-12T22:37:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56732024-12-12T22:37:06.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
56742024-12-12T22:37:06.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.824508ms iteration = 17 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
56752024-12-12T22:37:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1114 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 2530b1fd-b2ac-4d2f-8e97-632bddcb0ac4 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
56762024-12-12T22:37:09.637ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
56772024-12-12T22:37:09.637ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
56782024-12-12T22:37:09.668ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
56792024-12-12T22:37:09.668ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:37087
56802024-12-12T22:37:09.668ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37087 req_id = 37287f23-037b-40ed-a4b4-4cb6047665d4 roles = RoleSet { roles: {} } uri = /metrics/producers
56812024-12-12T22:37:09.669ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37087 req_id = 37287f23-037b-40ed-a4b4-4cb6047665d4 resource = Database result = Ok(()) uri = /metrics/producers
56822024-12-12T22:37:09.706ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
56832024-12-12T22:37:09.706ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37327 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:37087 req_id = 37287f23-037b-40ed-a4b4-4cb6047665d4 response_code = 201 uri = /metrics/producers
56842024-12-12T22:37:09.706ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "37287f23-037b-40ed-a4b4-4cb6047665d4", "content-length": "41", "date": "Thu, 12 Dec 2024 22:37:09 GMT"} })
56852024-12-12T22:37:09.707ZDEBGnexus (producer-registration-task): registered with nexus successfully
56862024-12-12T22:37:09.707ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
56872024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 18 reason = Timeout
56882024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56892024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 18 reason = Timeout
56902024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56912024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56922024-12-12T22:37:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56932024-12-12T22:37:16.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
56942024-12-12T22:37:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
56952024-12-12T22:37:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
56962024-12-12T22:37:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
56972024-12-12T22:37:16.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
56982024-12-12T22:37:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
56992024-12-12T22:37:16.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57002024-12-12T22:37:16.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57012024-12-12T22:37:16.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
57022024-12-12T22:37:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
57032024-12-12T22:37:16.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57042024-12-12T22:37:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57052024-12-12T22:37:16.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
57062024-12-12T22:37:16.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.35084ms iteration = 18 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
57072024-12-12T22:37:16.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 31.237883ms iteration = 18 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
57082024-12-12T22:37:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1239 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = e91e0f9e-bda8-4885-bd5b-9ceb28419c75 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
57092024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 19 reason = Timeout
57102024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 7 reason = Timeout
57112024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
57122024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 4 reason = Timeout
57132024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
57142024-12-12T22:37:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:27:26.105071780 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
57152024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 4 reason = Timeout
57162024-12-12T22:37:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
57172024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 5 reason = Timeout
57182024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
57192024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
57202024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
57212024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 7 reason = Timeout
57222024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
57232024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 7 reason = Timeout
57242024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
57252024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 4 reason = Timeout
57262024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
57272024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 7 reason = Timeout
57282024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
57292024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 5 reason = Timeout
57302024-12-12T22:37:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
57312024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.64\u{b5}s iteration = 5 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
57322024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 6 reason = Timeout
57332024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 8 reason = Timeout
57342024-12-12T22:37:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
57352024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 7 reason = Timeout
57362024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
57372024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 7 reason = Timeout
57382024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
57392024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 5 reason = Timeout
57402024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
57412024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
57422024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 7 reason = Timeout
57432024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
57442024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
57452024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 19 reason = Timeout
57462024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
57472024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 3 reason = Timeout
57482024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 5 reason = Timeout
57492024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57502024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
57512024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
57522024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 7 reason = Timeout
57532024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
57542024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 5 reason = Timeout
57552024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 9 reason = Timeout
57562024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
57572024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 5 reason = Timeout
57582024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 7 reason = Timeout
57592024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
57602024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 6 reason = Timeout
57612024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
57622024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
57632024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
57642024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
57652024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
57662024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
57672024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
57682024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
57692024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
57702024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
57712024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
57722024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
57732024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
57742024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
57752024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
57762024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
57772024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 4 reason = Timeout
57782024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57792024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
57802024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
57812024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 7 reason = Timeout
57822024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
57832024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 7 reason = Timeout
57842024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
57852024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
57862024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 7 reason = Timeout
57872024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 7 reason = Timeout
57882024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
57892024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
57902024-12-12T22:37:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 4 reason = Timeout
57912024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
57922024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
57932024-12-12T22:37:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3577, tv_nsec: 27691535 } })
57942024-12-12T22:37:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3577, tv_nsec: 27722905 } })
57952024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
57962024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
57972024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
57982024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
57992024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58002024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
58012024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
58022024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
58032024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58042024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58052024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58062024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58072024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
58082024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
58092024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.353306ms iteration = 5 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
58102024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.325236ms iteration = 5 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
58112024-12-12T22:37:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58122024-12-12T22:37:26.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3577, tv_nsec: 29724385 } })
58132024-12-12T22:37:26.108ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58142024-12-12T22:37:26.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
58152024-12-12T22:37:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.57746ms iteration = 7 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
58162024-12-12T22:37:26.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3577, tv_nsec: 31536340 } })
58172024-12-12T22:37:26.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
58182024-12-12T22:37:26.110ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:27:26.105071780 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
58192024-12-12T22:37:26.110ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 5.454997ms iteration = 4 status = {"expiration":"2024-12-12T22:27:26.105071780Z","pruned":[]}
58202024-12-12T22:37:26.110ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58212024-12-12T22:37:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
58222024-12-12T22:37:26.111ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58232024-12-12T22:37:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58242024-12-12T22:37:26.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
58252024-12-12T22:37:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
58262024-12-12T22:37:26.113ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
58272024-12-12T22:37:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
58282024-12-12T22:37:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
58292024-12-12T22:37:26.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58302024-12-12T22:37:26.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58312024-12-12T22:37:26.117ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
58322024-12-12T22:37:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
58332024-12-12T22:37:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
58342024-12-12T22:37:26.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
58352024-12-12T22:37:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
58362024-12-12T22:37:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
58372024-12-12T22:37:26.118ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
58382024-12-12T22:37:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
58392024-12-12T22:37:26.119ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
58402024-12-12T22:37:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
58412024-12-12T22:37:26.120ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58422024-12-12T22:37:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58432024-12-12T22:37:26.122ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58442024-12-12T22:37:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58452024-12-12T22:37:26.125ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.617965ms iteration = 4 status = {"errors":[],"found_port_ok":[]}
58462024-12-12T22:37:26.126ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58472024-12-12T22:37:26.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58482024-12-12T22:37:26.129ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58492024-12-12T22:37:26.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58502024-12-12T22:37:26.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
58512024-12-12T22:37:26.136ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
58522024-12-12T22:37:26.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58532024-12-12T22:37:26.150ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
58542024-12-12T22:37:26.150ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58552024-12-12T22:37:26.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58562024-12-12T22:37:26.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58572024-12-12T22:37:26.157ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
58582024-12-12T22:37:26.157ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
58592024-12-12T22:37:26.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
58602024-12-12T22:37:26.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58612024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
58622024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
58632024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
58642024-12-12T22:37:26.160ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
58652024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
58662024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
58672024-12-12T22:37:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
58682024-12-12T22:37:26.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58692024-12-12T22:37:26.168ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3577, tv_nsec: 90609610 } })
58702024-12-12T22:37:26.169ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
58712024-12-12T22:37:26.169ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58722024-12-12T22:37:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
58732024-12-12T22:37:26.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58742024-12-12T22:37:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
58752024-12-12T22:37:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58762024-12-12T22:37:26.174ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
58772024-12-12T22:37:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
58782024-12-12T22:37:26.175ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
58792024-12-12T22:37:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
58802024-12-12T22:37:26.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 70.487075ms iteration = 7 status = {"errors":[],"records_set_to_done":[]}
58812024-12-12T22:37:26.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.469724ms iteration = 19 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
58822024-12-12T22:37:26.177ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
58832024-12-12T22:37:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
58842024-12-12T22:37:26.177ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58852024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
58862024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
58872024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
58882024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
58892024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
58902024-12-12T22:37:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
58912024-12-12T22:37:26.181ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
58922024-12-12T22:37:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
58932024-12-12T22:37:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
58942024-12-12T22:37:26.182ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
58952024-12-12T22:37:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
58962024-12-12T22:37:26.183ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
58972024-12-12T22:37:26.183ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
58982024-12-12T22:37:26.183ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 77.563513ms iteration = 4 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
58992024-12-12T22:37:26.183ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 77.693555ms iteration = 7 status = {"errors":[],"garbage_collect_requested":[]}
59002024-12-12T22:37:26.184ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59012024-12-12T22:37:26.185ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59022024-12-12T22:37:26.186ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59032024-12-12T22:37:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59042024-12-12T22:37:26.186ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59052024-12-12T22:37:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59062024-12-12T22:37:26.186ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59072024-12-12T22:37:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
59082024-12-12T22:37:26.189ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
59092024-12-12T22:37:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
59102024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
59112024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
59122024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
59132024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59142024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
59152024-12-12T22:37:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59162024-12-12T22:37:26.193ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59172024-12-12T22:37:26.193ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 87.895886ms iteration = 3 status = {"nsuccess":5}
59182024-12-12T22:37:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59192024-12-12T22:37:26.194ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
59202024-12-12T22:37:26.194ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
59212024-12-12T22:37:26.194ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 89.154131ms iteration = 4 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
59222024-12-12T22:37:26.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59232024-12-12T22:37:26.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59242024-12-12T22:37:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59252024-12-12T22:37:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
59262024-12-12T22:37:26.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
59272024-12-12T22:37:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
59282024-12-12T22:37:26.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 96.919564ms iteration = 7 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
59292024-12-12T22:37:26.202ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59302024-12-12T22:37:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59312024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59322024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
59332024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
59342024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
59352024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
59362024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
59372024-12-12T22:37:26.210ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59382024-12-12T22:37:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59392024-12-12T22:37:26.211ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
59402024-12-12T22:37:26.211ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 105.91564ms iteration = 7 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
59412024-12-12T22:37:26.213ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
59422024-12-12T22:37:26.213ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 108.701605ms iteration = 19 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
59432024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
59442024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
59452024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
59462024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59472024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59482024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
59492024-12-12T22:37:26.214ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
59502024-12-12T22:37:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
59512024-12-12T22:37:26.216ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59522024-12-12T22:37:26.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59532024-12-12T22:37:26.218ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 113.153232ms iteration = 7 status = 0
59542024-12-12T22:37:26.218ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
59552024-12-12T22:37:26.218ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
59562024-12-12T22:37:26.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
59572024-12-12T22:37:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
59582024-12-12T22:37:26.220ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
59592024-12-12T22:37:26.220ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
59602024-12-12T22:37:26.220ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
59612024-12-12T22:37:26.221ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
59622024-12-12T22:37:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
59632024-12-12T22:37:26.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59642024-12-12T22:37:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
59652024-12-12T22:37:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
59662024-12-12T22:37:26.222ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59672024-12-12T22:37:26.225ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
59682024-12-12T22:37:26.225ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
59692024-12-12T22:37:26.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
59702024-12-12T22:37:26.229ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59712024-12-12T22:37:26.229ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59722024-12-12T22:37:26.229ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59732024-12-12T22:37:26.230ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "96be7bcb-20a5-4096-8b4b-d0dab012809d", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:25 GMT"} })
59742024-12-12T22:37:26.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59752024-12-12T22:37:26.230ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59762024-12-12T22:37:26.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59772024-12-12T22:37:26.232ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59782024-12-12T22:37:26.232ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
59792024-12-12T22:37:26.233ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
59802024-12-12T22:37:26.233ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
59812024-12-12T22:37:26.233ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a8ea5c8-4e4c-4452-a35d-22fcf6504b9b", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:25 GMT"} })
59822024-12-12T22:37:26.233ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
59832024-12-12T22:37:26.234ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
59842024-12-12T22:37:26.234ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
59852024-12-12T22:37:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
59862024-12-12T22:37:26.235ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
59872024-12-12T22:37:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 138.033761ms iteration = 9 status = {"physical_disks_added":0}
59882024-12-12T22:37:26.243ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 137.582022ms iteration = 7 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
59892024-12-12T22:37:26.244ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
59902024-12-12T22:37:26.244ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59912024-12-12T22:37:26.245ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59922024-12-12T22:37:26.246ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
59932024-12-12T22:37:26.248ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
59942024-12-12T22:37:26.248ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
59952024-12-12T22:37:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
59962024-12-12T22:37:26.263ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
59972024-12-12T22:37:26.263ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
59982024-12-12T22:37:26.263ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
59992024-12-12T22:37:26.263ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60002024-12-12T22:37:26.263ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 157.949173ms iteration = 7 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
60012024-12-12T22:37:26.265ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60022024-12-12T22:37:26.267ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
60032024-12-12T22:37:26.267ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
60042024-12-12T22:37:26.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
60052024-12-12T22:37:26.272ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
60062024-12-12T22:37:26.272ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
60072024-12-12T22:37:26.272ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
60082024-12-12T22:37:26.272ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 167.52078ms iteration = 5 status = {"generation":1}
60092024-12-12T22:37:26.275ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
60102024-12-12T22:37:26.275ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 170.225743ms iteration = 4 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
60112024-12-12T22:37:26.277ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
60122024-12-12T22:37:26.277ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
60132024-12-12T22:37:26.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60142024-12-12T22:37:26.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60152024-12-12T22:37:26.279ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
60162024-12-12T22:37:26.279ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
60172024-12-12T22:37:26.279ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 173.937206ms iteration = 7 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
60182024-12-12T22:37:26.285ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60192024-12-12T22:37:26.288ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
60202024-12-12T22:37:26.288ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
60212024-12-12T22:37:26.288ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
60222024-12-12T22:37:26.302ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
60232024-12-12T22:37:26.302ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 197.616881ms iteration = 5 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
60242024-12-12T22:37:26.317ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
60252024-12-12T22:37:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
60262024-12-12T22:37:26.320ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
60272024-12-12T22:37:26.320ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
60282024-12-12T22:37:26.322ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
60292024-12-12T22:37:26.322ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
60302024-12-12T22:37:26.322ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
60312024-12-12T22:37:26.322ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 216.971011ms iteration = 5 status = {"generation":2}
60322024-12-12T22:37:26.373ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
60332024-12-12T22:37:26.373ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
60342024-12-12T22:37:26.374ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "28be8805-5245-41b0-bf47-47904a4fde4b", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:25 GMT"} })
60352024-12-12T22:37:26.374ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
60362024-12-12T22:37:26.375ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
60372024-12-12T22:37:26.494ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
60382024-12-12T22:37:26.494ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "4c2d86f0-ebd2-4ed3-8c9a-5404ce938b7f", "date": "Thu, 12 Dec 2024 22:37:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60392024-12-12T22:37:26.494ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60402024-12-12T22:37:26.496ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "998559a9-5420-4ba6-9eb1-5565cc9c30ff", "date": "Thu, 12 Dec 2024 22:37:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60412024-12-12T22:37:26.496ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60422024-12-12T22:37:26.497ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
60432024-12-12T22:37:26.497ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 392.406317ms iteration = 6 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
60442024-12-12T22:37:26.538ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
60452024-12-12T22:37:26.538ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60462024-12-12T22:37:26.538ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "986cf593-5c48-42a3-a230-53fcc64494ad", "content-length": "372", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60472024-12-12T22:37:26.538ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60482024-12-12T22:37:26.538ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60492024-12-12T22:37:26.558ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 452.941636ms iteration = 7 status = {}
60502024-12-12T22:37:26.566ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
60512024-12-12T22:37:26.566ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "abd0c2ab-e74b-4af0-bbc1-22a8622be6f8", "content-length": "1", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60522024-12-12T22:37:26.567ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
60532024-12-12T22:37:26.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
60542024-12-12T22:37:26.574ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
60552024-12-12T22:37:26.574ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "87b79e88-21ca-4542-bfd6-8e7175d100ab", "content-length": "691", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60562024-12-12T22:37:26.574ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
60572024-12-12T22:37:26.574ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
60582024-12-12T22:37:26.574ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
60592024-12-12T22:37:26.575ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 470.229065ms iteration = 7 status = {}
60602024-12-12T22:37:26.575ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
60612024-12-12T22:37:26.576ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 471.774416ms iteration = 7 status = null
60622024-12-12T22:37:26.613ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
60632024-12-12T22:37:26.613ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
60642024-12-12T22:37:26.613ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "a6758365-b524-4074-8299-4e2455d1da43", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60652024-12-12T22:37:26.613ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60662024-12-12T22:37:26.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60672024-12-12T22:37:26.619ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60682024-12-12T22:37:26.619ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60692024-12-12T22:37:26.622ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
60702024-12-12T22:37:26.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
60712024-12-12T22:37:26.627ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
60722024-12-12T22:37:26.627ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
60732024-12-12T22:37:26.627ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "158ec3e0-2175-4d6e-8081-fbb6a9a9b36b", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60742024-12-12T22:37:26.629ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 524.671134ms iteration = 8 status = {}
60752024-12-12T22:37:26.639ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
60762024-12-12T22:37:26.640ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "5002bf25-67c1-46e7-9b93-5f8e8b03b3d5", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60772024-12-12T22:37:26.640ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60782024-12-12T22:37:26.642ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3dad21e8-ef55-4342-9bcc-8d4e29c167c7", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60792024-12-12T22:37:26.642ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60802024-12-12T22:37:26.643ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "5f9bd325-14e0-49c1-aa38-80275782ae25", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60812024-12-12T22:37:26.643ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60822024-12-12T22:37:26.645ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
60832024-12-12T22:37:26.645ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 540.662399ms iteration = 6 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
60842024-12-12T22:37:26.680ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60852024-12-12T22:37:26.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60862024-12-12T22:37:26.682ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
60872024-12-12T22:37:26.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
60882024-12-12T22:37:26.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
60892024-12-12T22:37:26.692ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
60902024-12-12T22:37:26.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "59e826f5-3dd9-403f-9762-106b4730b318", "content-length": "134", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
60912024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
60922024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
60932024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
60942024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
60952024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60962024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60972024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
60982024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
60992024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
61002024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
61012024-12-12T22:37:26.693ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
61022024-12-12T22:37:26.693ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61032024-12-12T22:37:26.693ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61042024-12-12T22:37:26.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
61052024-12-12T22:37:26.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "951394bb-cbe0-4a27-a5b6-84de5d7ecdbd", "content-length": "2", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
61062024-12-12T22:37:26.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
61072024-12-12T22:37:26.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "9cbba514-d866-49a3-9cfe-b162a1794e2d", "content-length": "52", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
61082024-12-12T22:37:26.696ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
61092024-12-12T22:37:26.696ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
61102024-12-12T22:37:26.785ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "6323d32a-c0c5-4447-af8a-bbf503dc1772", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
61112024-12-12T22:37:26.785ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
61122024-12-12T22:37:26.785ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
61132024-12-12T22:37:26.786ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1548f181-af47-459c-8a93-50c64db223ba", "content-length": "682", "date": "Thu, 12 Dec 2024 22:37:26 GMT"} })
61142024-12-12T22:37:26.786ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61152024-12-12T22:37:26.786ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61162024-12-12T22:37:26.880ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61172024-12-12T22:37:26.880ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61182024-12-12T22:37:26.883ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61192024-12-12T22:37:26.884ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61202024-12-12T22:37:26.885ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61212024-12-12T22:37:26.886ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
61222024-12-12T22:37:26.892ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 787.552067ms iteration = 7 status = {}
61232024-12-12T22:37:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1136 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 36c7bdf3-dc4c-4d24-83ff-260772f7be50 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
61242024-12-12T22:37:36.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 20 reason = Timeout
61252024-12-12T22:37:36.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 20 reason = Timeout
61262024-12-12T22:37:36.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61272024-12-12T22:37:36.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61282024-12-12T22:37:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61292024-12-12T22:37:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61302024-12-12T22:37:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61312024-12-12T22:37:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61322024-12-12T22:37:36.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61332024-12-12T22:37:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61342024-12-12T22:37:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61352024-12-12T22:37:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61362024-12-12T22:37:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61372024-12-12T22:37:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
61382024-12-12T22:37:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61392024-12-12T22:37:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61402024-12-12T22:37:36.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
61412024-12-12T22:37:36.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.126705ms iteration = 20 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
61422024-12-12T22:37:36.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61432024-12-12T22:37:36.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61442024-12-12T22:37:36.163ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.153922ms iteration = 20 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61452024-12-12T22:37:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1193 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 3d709c85-ed7f-4880-9ffc-4749bc64ff31 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
61462024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 21 reason = Timeout
61472024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61482024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 21 reason = Timeout
61492024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61502024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61512024-12-12T22:37:46.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61522024-12-12T22:37:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61532024-12-12T22:37:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
61542024-12-12T22:37:46.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61552024-12-12T22:37:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61562024-12-12T22:37:46.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61572024-12-12T22:37:46.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61582024-12-12T22:37:46.138ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61592024-12-12T22:37:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
61602024-12-12T22:37:46.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.496197ms iteration = 21 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
61612024-12-12T22:37:46.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
61622024-12-12T22:37:46.146ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
61632024-12-12T22:37:46.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61642024-12-12T22:37:46.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
61652024-12-12T22:37:46.158ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
61662024-12-12T22:37:46.158ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.305547ms iteration = 21 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
61672024-12-12T22:37:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1213 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 83ed67a8-a9ca-4ebb-a375-92f915338afb response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
61682024-12-12T22:37:48.364ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:55041
61692024-12-12T22:37:48.364ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55041 req_id = 45e93ade-d115-4c7d-b9a6-e0e837c0b605 roles = RoleSet { roles: {} } uri = /metrics/producers
61702024-12-12T22:37:48.364ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55041 req_id = 45e93ade-d115-4c7d-b9a6-e0e837c0b605 resource = Database result = Ok(()) uri = /metrics/producers
61712024-12-12T22:37:48.409ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 4a8c9490-d35a-4221-8585-e4103b325118
61722024-12-12T22:37:48.409ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45446 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:55041 req_id = 45e93ade-d115-4c7d-b9a6-e0e837c0b605 response_code = 201 uri = /metrics/producers
61732024-12-12T22:37:55.006ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61406
61742024-12-12T22:37:55.006ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61406 req_id = ee69305b-b49f-4421-9c9a-824cd82ce075 roles = RoleSet { roles: {} } uri = /metrics/producers
61752024-12-12T22:37:55.006ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61406 req_id = ee69305b-b49f-4421-9c9a-824cd82ce075 resource = Database result = Ok(()) uri = /metrics/producers
61762024-12-12T22:37:55.045ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e7680fb8-0ccd-466c-b928-9ebe5b97f2ca
61772024-12-12T22:37:55.045ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39014 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61406 req_id = ee69305b-b49f-4421-9c9a-824cd82ce075 response_code = 201 uri = /metrics/producers
61782024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 8 reason = Timeout
61792024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 8 reason = Timeout
61802024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
61812024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
61822024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 22 reason = Timeout
61832024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
61842024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 8 reason = Timeout
61852024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
61862024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
61872024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 8 reason = Timeout
61882024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
61892024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 10 reason = Timeout
61902024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 8 reason = Timeout
61912024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
61922024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 8 reason = Timeout
61932024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
61942024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
61952024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 22 reason = Timeout
61962024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 8 reason = Timeout
61972024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
61982024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
61992024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 9 reason = Timeout
62002024-12-12T22:37:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
62012024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 8 reason = Timeout
62022024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62032024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 8 reason = Timeout
62042024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62052024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 8 reason = Timeout
62062024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 8 reason = Timeout
62072024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62082024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
62092024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 8 reason = Timeout
62102024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
62112024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 8 reason = Timeout
62122024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62132024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62142024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62152024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
62162024-12-12T22:37:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62172024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
62182024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62192024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62202024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62212024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62222024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62232024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
62242024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
62252024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62262024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
62272024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62282024-12-12T22:37:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62292024-12-12T22:37:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62302024-12-12T22:37:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3607, tv_nsec: 30981362 } })
62312024-12-12T22:37:56.109ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62322024-12-12T22:37:56.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.930747ms iteration = 8 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
62332024-12-12T22:37:56.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
62342024-12-12T22:37:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
62352024-12-12T22:37:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
62362024-12-12T22:37:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
62372024-12-12T22:37:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
62382024-12-12T22:37:56.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
62392024-12-12T22:37:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
62402024-12-12T22:37:56.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62412024-12-12T22:37:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
62422024-12-12T22:37:56.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62432024-12-12T22:37:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62442024-12-12T22:37:56.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62452024-12-12T22:37:56.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3607, tv_nsec: 46000327 } })
62462024-12-12T22:37:56.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
62472024-12-12T22:37:56.125ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 19.453782ms iteration = 8 status = {"errors":[],"garbage_collect_requested":[]}
62482024-12-12T22:37:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62492024-12-12T22:37:56.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62502024-12-12T22:37:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62512024-12-12T22:37:56.131ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3607, tv_nsec: 53451523 } })
62522024-12-12T22:37:56.132ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
62532024-12-12T22:37:56.132ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62542024-12-12T22:37:56.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62552024-12-12T22:37:56.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62562024-12-12T22:37:56.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62572024-12-12T22:37:56.154ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
62582024-12-12T22:37:56.154ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
62592024-12-12T22:37:56.154ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
62602024-12-12T22:37:56.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
62612024-12-12T22:37:56.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
62622024-12-12T22:37:56.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
62632024-12-12T22:37:56.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62642024-12-12T22:37:56.164ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
62652024-12-12T22:37:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
62662024-12-12T22:37:56.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
62672024-12-12T22:37:56.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62682024-12-12T22:37:56.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62692024-12-12T22:37:56.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62702024-12-12T22:37:56.169ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62712024-12-12T22:37:56.169ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
62722024-12-12T22:37:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
62732024-12-12T22:37:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
62742024-12-12T22:37:56.170ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
62752024-12-12T22:37:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
62762024-12-12T22:37:56.170ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
62772024-12-12T22:37:56.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
62782024-12-12T22:37:56.171ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62792024-12-12T22:37:56.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62802024-12-12T22:37:56.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62812024-12-12T22:37:56.171ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 65.755121ms iteration = 8 status = {"errors":[],"records_set_to_done":[]}
62822024-12-12T22:37:56.172ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
62832024-12-12T22:37:56.172ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
62842024-12-12T22:37:56.172ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.065118ms iteration = 8 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
62852024-12-12T22:37:56.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
62862024-12-12T22:37:56.173ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62872024-12-12T22:37:56.175ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
62882024-12-12T22:37:56.175ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
62892024-12-12T22:37:56.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
62902024-12-12T22:37:56.176ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
62912024-12-12T22:37:56.176ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
62922024-12-12T22:37:56.178ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a160d212-1fd3-4e6d-a51b-4ef6b748a81a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:55 GMT"} })
62932024-12-12T22:37:56.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
62942024-12-12T22:37:56.179ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
62952024-12-12T22:37:56.180ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
62962024-12-12T22:37:56.183ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
62972024-12-12T22:37:56.183ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
62982024-12-12T22:37:56.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
62992024-12-12T22:37:56.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
63002024-12-12T22:37:56.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 91.989297ms iteration = 22 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
63012024-12-12T22:37:56.199ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 94.536747ms iteration = 22 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
63022024-12-12T22:37:56.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63032024-12-12T22:37:56.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63042024-12-12T22:37:56.203ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63052024-12-12T22:37:56.203ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
63062024-12-12T22:37:56.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
63072024-12-12T22:37:56.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63082024-12-12T22:37:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
63092024-12-12T22:37:56.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63102024-12-12T22:37:56.206ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63112024-12-12T22:37:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
63122024-12-12T22:37:56.209ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
63132024-12-12T22:37:56.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
63142024-12-12T22:37:56.210ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
63152024-12-12T22:37:56.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
63162024-12-12T22:37:56.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 105.499882ms iteration = 8 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
63172024-12-12T22:37:56.211ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 106.336909ms iteration = 8 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
63182024-12-12T22:37:56.211ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 106.43399ms iteration = 8 status = 0
63192024-12-12T22:37:56.212ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
63202024-12-12T22:37:56.212ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63212024-12-12T22:37:56.212ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "05ac3482-7d89-475c-8475-720fde9a5f96", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:55 GMT"} })
63222024-12-12T22:37:56.212ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63232024-12-12T22:37:56.213ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
63242024-12-12T22:37:56.220ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
63252024-12-12T22:37:56.221ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
63262024-12-12T22:37:56.221ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "634f16f5-2113-4d7d-be7d-e58d1fc37959", "content-length": "26", "date": "Thu, 12 Dec 2024 22:37:55 GMT"} })
63272024-12-12T22:37:56.221ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
63282024-12-12T22:37:56.222ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
63292024-12-12T22:37:56.235ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
63302024-12-12T22:37:56.235ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
63312024-12-12T22:37:56.235ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 130.279209ms iteration = 8 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
63322024-12-12T22:37:56.238ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63332024-12-12T22:37:56.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63342024-12-12T22:37:56.246ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 140.647112ms iteration = 8 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
63352024-12-12T22:37:56.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 154.718668ms iteration = 8 status = {}
63362024-12-12T22:37:56.279ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 173.672851ms iteration = 10 status = {"physical_disks_added":0}
63372024-12-12T22:37:56.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63382024-12-12T22:37:56.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63392024-12-12T22:37:56.339ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63402024-12-12T22:37:56.340ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63412024-12-12T22:37:56.340ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63422024-12-12T22:37:56.341ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63432024-12-12T22:37:56.367ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
63442024-12-12T22:37:56.369ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
63452024-12-12T22:37:56.369ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
63462024-12-12T22:37:56.369ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
63472024-12-12T22:37:56.391ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
63482024-12-12T22:37:56.392ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee5f2140-c01d-4dbf-a126-0234ad1f05d8", "content-length": "1", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63492024-12-12T22:37:56.393ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
63502024-12-12T22:37:56.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
63512024-12-12T22:37:56.408ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
63522024-12-12T22:37:56.408ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63532024-12-12T22:37:56.408ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "41b05f85-daa1-4d82-a4c4-c05b52822837", "content-length": "372", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63542024-12-12T22:37:56.408ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63552024-12-12T22:37:56.409ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63562024-12-12T22:37:56.413ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 307.640383ms iteration = 8 status = null
63572024-12-12T22:37:56.461ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
63582024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
63592024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63602024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "19dce8b8-d40f-4ceb-9c86-2b8840242ae1", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63612024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63622024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63632024-12-12T22:37:56.461ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63642024-12-12T22:37:56.463ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
63652024-12-12T22:37:56.463ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63662024-12-12T22:37:56.464ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63672024-12-12T22:37:56.465ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63682024-12-12T22:37:56.465ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63692024-12-12T22:37:56.480ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
63702024-12-12T22:37:56.481ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "59012ae5-0729-4f2b-9404-510b17b57c59", "content-length": "691", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63712024-12-12T22:37:56.481ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
63722024-12-12T22:37:56.481ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
63732024-12-12T22:37:56.481ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
63742024-12-12T22:37:56.483ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 377.620046ms iteration = 8 status = {}
63752024-12-12T22:37:56.484ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
63762024-12-12T22:37:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
63772024-12-12T22:37:56.490ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
63782024-12-12T22:37:56.490ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
63792024-12-12T22:37:56.490ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "95576312-2e01-4127-bd89-ef05f2860806", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63802024-12-12T22:37:56.490ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
63812024-12-12T22:37:56.491ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "4f5a318c-496d-4580-9e96-57150c1d6fdb", "content-length": "134", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63822024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
63832024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
63842024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
63852024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
63862024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63872024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63882024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63892024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63902024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
63912024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
63922024-12-12T22:37:56.491ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
63932024-12-12T22:37:56.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
63942024-12-12T22:37:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
63952024-12-12T22:37:56.492ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 386.725925ms iteration = 9 status = {}
63962024-12-12T22:37:56.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
63972024-12-12T22:37:56.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2f90640-10e3-4741-866a-b79a707e34f9", "content-length": "2", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
63982024-12-12T22:37:56.494ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
63992024-12-12T22:37:56.494ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "b25d9e15-ddf1-428c-a8e3-710edd363c96", "content-length": "52", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
64002024-12-12T22:37:56.494ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
64012024-12-12T22:37:56.494ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
64022024-12-12T22:37:56.584ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8dc32743-ec84-40de-9e99-399e9f61b959", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
64032024-12-12T22:37:56.584ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
64042024-12-12T22:37:56.584ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
64052024-12-12T22:37:56.584ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "53980864-a4c4-49b1-bbdd-3123328a0d34", "content-length": "682", "date": "Thu, 12 Dec 2024 22:37:56 GMT"} })
64062024-12-12T22:37:56.584ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64072024-12-12T22:37:56.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64082024-12-12T22:37:56.588ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64092024-12-12T22:37:56.589ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64102024-12-12T22:37:56.592ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64112024-12-12T22:37:56.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64122024-12-12T22:37:56.594ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64132024-12-12T22:37:56.595ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
64142024-12-12T22:37:56.602ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 496.727726ms iteration = 8 status = {}
64152024-12-12T22:37:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1060 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = d649e4f1-2c69-4fcf-a2b8-b5cccf1affc5 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
64162024-12-12T22:38:03.025ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34825
64172024-12-12T22:38:03.025ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34825 req_id = eadc89ec-4f11-4f78-8fa9-f3831385aaef roles = RoleSet { roles: {} } uri = /metrics/producers
64182024-12-12T22:38:03.025ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34825 req_id = eadc89ec-4f11-4f78-8fa9-f3831385aaef resource = Database result = Ok(()) uri = /metrics/producers
64192024-12-12T22:38:03.061ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 9be55e3b-79ee-4930-a117-2473cfadb163
64202024-12-12T22:38:03.061ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36082 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34825 req_id = eadc89ec-4f11-4f78-8fa9-f3831385aaef response_code = 201 uri = /metrics/producers
64212024-12-12T22:38:05.194ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:61683
64222024-12-12T22:38:05.194ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61683 req_id = 5bb9df5f-6b1a-47aa-acce-d8b0e24c66a9 roles = RoleSet { roles: {} } uri = /metrics/producers
64232024-12-12T22:38:05.194ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61683 req_id = 5bb9df5f-6b1a-47aa-acce-d8b0e24c66a9 resource = Database result = Ok(()) uri = /metrics/producers
64242024-12-12T22:38:05.231ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e736935f-49fd-4441-90a4-7226a6f1fe8e
64252024-12-12T22:38:05.231ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 37037 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:61683 req_id = 5bb9df5f-6b1a-47aa-acce-d8b0e24c66a9 response_code = 201 uri = /metrics/producers
64262024-12-12T22:38:05.877ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:50188
64272024-12-12T22:38:05.877ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50188 req_id = e562b206-5e9c-4544-a067-822084da5c57 roles = RoleSet { roles: {} } uri = /metrics/producers
64282024-12-12T22:38:05.878ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50188 req_id = e562b206-5e9c-4544-a067-822084da5c57 resource = Database result = Ok(()) uri = /metrics/producers
64292024-12-12T22:38:05.912ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 35574f6f-1e6c-4add-9efb-f5d5c83e2007
64302024-12-12T22:38:05.912ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 34881 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:50188 req_id = e562b206-5e9c-4544-a067-822084da5c57 response_code = 201 uri = /metrics/producers
64312024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 23 reason = Timeout
64322024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 23 reason = Timeout
64332024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64342024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64352024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64362024-12-12T22:38:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64372024-12-12T22:38:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64382024-12-12T22:38:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64392024-12-12T22:38:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64402024-12-12T22:38:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64412024-12-12T22:38:06.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64422024-12-12T22:38:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64432024-12-12T22:38:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64442024-12-12T22:38:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
64452024-12-12T22:38:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64462024-12-12T22:38:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64472024-12-12T22:38:06.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
64482024-12-12T22:38:06.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.92251ms iteration = 23 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
64492024-12-12T22:38:06.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64502024-12-12T22:38:06.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64512024-12-12T22:38:06.136ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.773584ms iteration = 23 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64522024-12-12T22:38:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1163 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = d967c652-c49c-4a67-a9ae-4df30afe433b response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
64532024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 24 reason = Timeout
64542024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64552024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 24 reason = Timeout
64562024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64572024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64582024-12-12T22:38:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64592024-12-12T22:38:16.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
64602024-12-12T22:38:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
64612024-12-12T22:38:16.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64622024-12-12T22:38:16.139ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 34.565539ms iteration = 24 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
64632024-12-12T22:38:16.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
64642024-12-12T22:38:16.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64652024-12-12T22:38:16.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64662024-12-12T22:38:16.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64672024-12-12T22:38:16.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64682024-12-12T22:38:16.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
64692024-12-12T22:38:16.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
64702024-12-12T22:38:16.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64712024-12-12T22:38:16.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
64722024-12-12T22:38:16.160ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
64732024-12-12T22:38:16.160ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 54.930519ms iteration = 24 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
64742024-12-12T22:38:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1073 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 3dc4fb88-4193-4755-9582-e886ec7dc3d6 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
64752024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 9 reason = Timeout
64762024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 9 reason = Timeout
64772024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
64782024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 5 reason = Timeout
64792024-12-12T22:38:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
64802024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 10 reason = Timeout
64812024-12-12T22:38:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
64822024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 7 reason = Timeout
64832024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
64842024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 25 reason = Timeout
64852024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
64862024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 5 reason = Timeout
64872024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
64882024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
64892024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 9 reason = Timeout
64902024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
64912024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 5 reason = Timeout
64922024-12-12T22:38:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:28:26.105530446 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
64932024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
64942024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 6 reason = Timeout
64952024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 6 reason = Timeout
64962024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 6 reason = Timeout
64972024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
64982024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 6 reason = Timeout
64992024-12-12T22:38:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
65002024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 6 reason = Timeout
65012024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.37\u{b5}s iteration = 6 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
65022024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
65032024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65042024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 9 reason = Timeout
65052024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
65062024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 9 reason = Timeout
65072024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 9 reason = Timeout
65082024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
65092024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
65102024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 11 reason = Timeout
65112024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
65122024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
65132024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 9 reason = Timeout
65142024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
65152024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 9 reason = Timeout
65162024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 6 reason = Timeout
65172024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
65182024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
65192024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65202024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 25 reason = Timeout
65212024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65222024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 7 reason = Timeout
65232024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 9 reason = Timeout
65242024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
65252024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 9 reason = Timeout
65262024-12-12T22:38:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
65272024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 5 reason = Timeout
65282024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
65292024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 9 reason = Timeout
65302024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
65312024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 9 reason = Timeout
65322024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
65332024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 9 reason = Timeout
65342024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
65352024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 5 reason = Timeout
65362024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
65372024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65382024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65392024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65402024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
65412024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
65422024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65432024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
65442024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65452024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
65462024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65472024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
65482024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
65492024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
65502024-12-12T22:38:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3637, tv_nsec: 28010657 } })
65512024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
65522024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65532024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
65542024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
65552024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
65562024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
65572024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
65582024-12-12T22:38:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3637, tv_nsec: 28070428 } })
65592024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
65602024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
65612024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
65622024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
65632024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
65642024-12-12T22:38:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.378497ms iteration = 6 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
65652024-12-12T22:38:26.107ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
65662024-12-12T22:38:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.440619ms iteration = 6 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
65672024-12-12T22:38:26.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65682024-12-12T22:38:26.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65692024-12-12T22:38:26.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65702024-12-12T22:38:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.212503ms iteration = 9 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
65712024-12-12T22:38:26.110ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:28:26.105530446 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
65722024-12-12T22:38:26.110ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.997558ms iteration = 5 status = {"expiration":"2024-12-12T22:28:26.105530446Z","pruned":[]}
65732024-12-12T22:38:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
65742024-12-12T22:38:26.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
65752024-12-12T22:38:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
65762024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
65772024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
65782024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
65792024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
65802024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
65812024-12-12T22:38:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
65822024-12-12T22:38:26.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
65832024-12-12T22:38:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
65842024-12-12T22:38:26.112ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65852024-12-12T22:38:26.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3637, tv_nsec: 35169707 } })
65862024-12-12T22:38:26.113ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
65872024-12-12T22:38:26.114ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65882024-12-12T22:38:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
65892024-12-12T22:38:26.115ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
65902024-12-12T22:38:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
65912024-12-12T22:38:26.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
65922024-12-12T22:38:26.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
65932024-12-12T22:38:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
65942024-12-12T22:38:26.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65952024-12-12T22:38:26.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
65962024-12-12T22:38:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
65972024-12-12T22:38:26.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
65982024-12-12T22:38:26.119ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
65992024-12-12T22:38:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
66002024-12-12T22:38:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
66012024-12-12T22:38:26.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66022024-12-12T22:38:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66032024-12-12T22:38:26.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3637, tv_nsec: 42590863 } })
66042024-12-12T22:38:26.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
66052024-12-12T22:38:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66062024-12-12T22:38:26.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66072024-12-12T22:38:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66082024-12-12T22:38:26.125ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 19.218868ms iteration = 5 status = {"errors":[],"found_port_ok":[]}
66092024-12-12T22:38:26.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66102024-12-12T22:38:26.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66112024-12-12T22:38:26.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66122024-12-12T22:38:26.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3637, tv_nsec: 49883636 } })
66132024-12-12T22:38:26.128ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66142024-12-12T22:38:26.128ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
66152024-12-12T22:38:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66162024-12-12T22:38:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66172024-12-12T22:38:26.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66182024-12-12T22:38:26.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66192024-12-12T22:38:26.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66202024-12-12T22:38:26.148ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66212024-12-12T22:38:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66222024-12-12T22:38:26.150ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
66232024-12-12T22:38:26.150ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
66242024-12-12T22:38:26.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
66252024-12-12T22:38:26.168ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66262024-12-12T22:38:26.168ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
66272024-12-12T22:38:26.168ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66282024-12-12T22:38:26.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66292024-12-12T22:38:26.169ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66302024-12-12T22:38:26.170ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66312024-12-12T22:38:26.171ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66322024-12-12T22:38:26.171ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
66332024-12-12T22:38:26.171ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 66.2318ms iteration = 25 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
66342024-12-12T22:38:26.172ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.046307ms iteration = 9 status = {"errors":[],"garbage_collect_requested":[]}
66352024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
66362024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66372024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66382024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
66392024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
66402024-12-12T22:38:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
66412024-12-12T22:38:26.174ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
66422024-12-12T22:38:26.174ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
66432024-12-12T22:38:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
66442024-12-12T22:38:26.175ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66452024-12-12T22:38:26.175ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66462024-12-12T22:38:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66472024-12-12T22:38:26.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66482024-12-12T22:38:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66492024-12-12T22:38:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
66502024-12-12T22:38:26.177ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
66512024-12-12T22:38:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
66522024-12-12T22:38:26.177ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66532024-12-12T22:38:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66542024-12-12T22:38:26.178ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
66552024-12-12T22:38:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
66562024-12-12T22:38:26.178ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 73.027074ms iteration = 9 status = {"errors":[],"records_set_to_done":[]}
66572024-12-12T22:38:26.179ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66582024-12-12T22:38:26.180ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66592024-12-12T22:38:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66602024-12-12T22:38:26.181ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
66612024-12-12T22:38:26.181ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
66622024-12-12T22:38:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
66632024-12-12T22:38:26.181ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 76.177646ms iteration = 9 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
66642024-12-12T22:38:26.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66652024-12-12T22:38:26.184ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
66662024-12-12T22:38:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
66672024-12-12T22:38:26.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
66682024-12-12T22:38:26.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
66692024-12-12T22:38:26.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
66702024-12-12T22:38:26.185ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
66712024-12-12T22:38:26.185ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
66722024-12-12T22:38:26.185ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 80.492781ms iteration = 5 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
66732024-12-12T22:38:26.187ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 81.426159ms iteration = 9 status = 0
66742024-12-12T22:38:26.187ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
66752024-12-12T22:38:26.187ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
66762024-12-12T22:38:26.187ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 81.710385ms iteration = 5 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
66772024-12-12T22:38:26.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66782024-12-12T22:38:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
66792024-12-12T22:38:26.193ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
66802024-12-12T22:38:26.193ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
66812024-12-12T22:38:26.193ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
66822024-12-12T22:38:26.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66832024-12-12T22:38:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66842024-12-12T22:38:26.194ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
66852024-12-12T22:38:26.198ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 92.886234ms iteration = 25 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
66862024-12-12T22:38:26.198ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
66872024-12-12T22:38:26.198ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
66882024-12-12T22:38:26.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
66892024-12-12T22:38:26.203ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
66902024-12-12T22:38:26.203ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
66912024-12-12T22:38:26.203ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
66922024-12-12T22:38:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
66932024-12-12T22:38:26.212ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
66942024-12-12T22:38:26.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
66952024-12-12T22:38:26.217ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
66962024-12-12T22:38:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
66972024-12-12T22:38:26.219ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
66982024-12-12T22:38:26.219ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 113.810036ms iteration = 9 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
66992024-12-12T22:38:26.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67002024-12-12T22:38:26.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67012024-12-12T22:38:26.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 123.691919ms iteration = 9 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
67022024-12-12T22:38:26.231ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
67032024-12-12T22:38:26.231ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
67042024-12-12T22:38:26.231ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
67052024-12-12T22:38:26.231ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67062024-12-12T22:38:26.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67072024-12-12T22:38:26.232ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
67082024-12-12T22:38:26.232ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 127.139287ms iteration = 6 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
67092024-12-12T22:38:26.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67102024-12-12T22:38:26.236ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
67112024-12-12T22:38:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67122024-12-12T22:38:26.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67132024-12-12T22:38:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67142024-12-12T22:38:26.237ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
67152024-12-12T22:38:26.244ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
67162024-12-12T22:38:26.244ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
67172024-12-12T22:38:26.244ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67182024-12-12T22:38:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67192024-12-12T22:38:26.246ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67202024-12-12T22:38:26.248ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
67212024-12-12T22:38:26.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
67222024-12-12T22:38:26.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
67232024-12-12T22:38:26.253ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
67242024-12-12T22:38:26.253ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
67252024-12-12T22:38:26.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 147.419735ms iteration = 9 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
67262024-12-12T22:38:26.256ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
67272024-12-12T22:38:26.256ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
67282024-12-12T22:38:26.256ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
67292024-12-12T22:38:26.256ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 150.941275ms iteration = 6 status = {"generation":1}
67302024-12-12T22:38:26.259ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 153.284031ms iteration = 9 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
67312024-12-12T22:38:26.259ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67322024-12-12T22:38:26.259ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67332024-12-12T22:38:26.259ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "77ed0d56-f57f-4583-863a-5a6126f11263", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} })
67342024-12-12T22:38:26.259ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67352024-12-12T22:38:26.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67362024-12-12T22:38:26.275ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
67372024-12-12T22:38:26.276ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67382024-12-12T22:38:26.276ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "95298a31-057b-4932-8c28-9da82ecbf373", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} })
67392024-12-12T22:38:26.276ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67402024-12-12T22:38:26.277ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
67412024-12-12T22:38:26.277ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
67422024-12-12T22:38:26.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67432024-12-12T22:38:26.277ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
67442024-12-12T22:38:26.278ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67452024-12-12T22:38:26.279ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67462024-12-12T22:38:26.280ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
67472024-12-12T22:38:26.280ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 175.381504ms iteration = 5 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
67482024-12-12T22:38:26.282ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
67492024-12-12T22:38:26.282ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
67502024-12-12T22:38:26.282ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
67512024-12-12T22:38:26.284ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
67522024-12-12T22:38:26.284ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
67532024-12-12T22:38:26.284ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
67542024-12-12T22:38:26.284ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 178.953205ms iteration = 6 status = {"generation":2}
67552024-12-12T22:38:26.288ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.438533ms iteration = 11 status = {"physical_disks_added":0}
67562024-12-12T22:38:26.291ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
67572024-12-12T22:38:26.291ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
67582024-12-12T22:38:26.291ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a0d6334a-096c-482e-82d0-0935d096cf8d", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} })
67592024-12-12T22:38:26.291ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
67602024-12-12T22:38:26.293ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
67612024-12-12T22:38:26.330ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67622024-12-12T22:38:26.330ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67632024-12-12T22:38:26.332ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67642024-12-12T22:38:26.334ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67652024-12-12T22:38:26.334ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67662024-12-12T22:38:26.334ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67672024-12-12T22:38:26.335ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
67682024-12-12T22:38:26.337ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
67692024-12-12T22:38:26.337ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
67702024-12-12T22:38:26.337ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
67712024-12-12T22:38:26.377ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
67722024-12-12T22:38:26.378ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "bf9794e9-41ea-4139-bcdb-26a5e536fc6a", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67732024-12-12T22:38:26.378ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67742024-12-12T22:38:26.379ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "cc421d15-7b74-4af8-8c61-07d347e47ed3", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67752024-12-12T22:38:26.379ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67762024-12-12T22:38:26.381ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
67772024-12-12T22:38:26.381ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 275.46763ms iteration = 7 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
67782024-12-12T22:38:26.441ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
67792024-12-12T22:38:26.441ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
67802024-12-12T22:38:26.441ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb272392-98d3-498a-b428-96abe78ec506", "content-length": "372", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} })
67812024-12-12T22:38:26.441ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67822024-12-12T22:38:26.441ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67832024-12-12T22:38:26.459ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
67842024-12-12T22:38:26.459ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
67852024-12-12T22:38:26.459ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "2c56eb25-18e0-4b58-9051-0ca57ef51402", "date": "Thu, 12 Dec 2024 22:38:25 GMT"} })
67862024-12-12T22:38:26.459ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67872024-12-12T22:38:26.459ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67882024-12-12T22:38:26.511ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
67892024-12-12T22:38:26.553ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
67902024-12-12T22:38:26.553ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e792a7aa-21e2-4000-a7b5-63fea133aa5f", "content-length": "1", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
67912024-12-12T22:38:26.555ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
67922024-12-12T22:38:26.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
67932024-12-12T22:38:26.557ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 451.313204ms iteration = 9 status = {}
67942024-12-12T22:38:26.557ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 451.732333ms iteration = 9 status = null
67952024-12-12T22:38:26.565ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67962024-12-12T22:38:26.565ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67972024-12-12T22:38:26.568ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
67982024-12-12T22:38:26.568ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
67992024-12-12T22:38:26.575ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
68002024-12-12T22:38:26.575ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "31b8922d-e751-4039-a5df-079cfe3458cc", "content-length": "691", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68012024-12-12T22:38:26.575ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
68022024-12-12T22:38:26.575ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
68032024-12-12T22:38:26.575ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
68042024-12-12T22:38:26.576ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 471.301156ms iteration = 9 status = {}
68052024-12-12T22:38:26.579ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
68062024-12-12T22:38:26.579ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
68072024-12-12T22:38:26.579ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "fdd6ae9f-dc82-4f2d-9de6-0244fddcc335", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68082024-12-12T22:38:26.581ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 475.949827ms iteration = 10 status = {}
68092024-12-12T22:38:26.594ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
68102024-12-12T22:38:26.594ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "e1cfd441-54e6-4350-8665-0d1d170f8e5b", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68112024-12-12T22:38:26.594ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68122024-12-12T22:38:26.596ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c88f44dc-7f69-4644-9c75-dddf3d2c8c50", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68132024-12-12T22:38:26.596ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68142024-12-12T22:38:26.598ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "92e5a877-f362-457f-9ec9-8001ce8fbbb3", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68152024-12-12T22:38:26.598ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68162024-12-12T22:38:26.600ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
68172024-12-12T22:38:26.600ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 495.104664ms iteration = 7 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
68182024-12-12T22:38:26.608ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68192024-12-12T22:38:26.608ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68202024-12-12T22:38:26.610ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
68212024-12-12T22:38:26.610ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68222024-12-12T22:38:26.611ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68232024-12-12T22:38:26.620ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
68242024-12-12T22:38:26.620ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f87da4f5-7c4a-4117-9817-508886d42525", "content-length": "134", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68252024-12-12T22:38:26.620ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
68262024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
68272024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
68282024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
68292024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68302024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68312024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68322024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68332024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
68342024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
68352024-12-12T22:38:26.621ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
68362024-12-12T22:38:26.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68372024-12-12T22:38:26.621ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68382024-12-12T22:38:26.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
68392024-12-12T22:38:26.623ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "fe2075d5-cea5-4d39-92a5-f1edbb7a06f9", "content-length": "2", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68402024-12-12T22:38:26.623ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
68412024-12-12T22:38:26.624ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "8b0c5dd7-efdb-4bd7-b129-0fe343b8b4ea", "content-length": "52", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68422024-12-12T22:38:26.624ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
68432024-12-12T22:38:26.624ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
68442024-12-12T22:38:26.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "0cbb4033-da12-4e3d-bef9-e577a3b5f2a2", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68452024-12-12T22:38:26.721ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
68462024-12-12T22:38:26.721ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
68472024-12-12T22:38:26.721ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "e26c4bd4-e33f-4340-bb74-c19e38c70f26", "content-length": "682", "date": "Thu, 12 Dec 2024 22:38:26 GMT"} })
68482024-12-12T22:38:26.721ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68492024-12-12T22:38:26.722ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68502024-12-12T22:38:26.725ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68512024-12-12T22:38:26.725ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68522024-12-12T22:38:26.729ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68532024-12-12T22:38:26.729ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68542024-12-12T22:38:26.731ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
68552024-12-12T22:38:26.732ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
68562024-12-12T22:38:26.738ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 632.914221ms iteration = 9 status = {}
68572024-12-12T22:38:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1055 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = b2f16431-3e84-4ed1-9d59-55fa430f7ba6 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
68582024-12-12T22:38:36.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 26 reason = Timeout
68592024-12-12T22:38:36.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 26 reason = Timeout
68602024-12-12T22:38:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68612024-12-12T22:38:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68622024-12-12T22:38:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68632024-12-12T22:38:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68642024-12-12T22:38:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68652024-12-12T22:38:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68662024-12-12T22:38:36.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68672024-12-12T22:38:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68682024-12-12T22:38:36.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68692024-12-12T22:38:36.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68702024-12-12T22:38:36.135ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68712024-12-12T22:38:36.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68722024-12-12T22:38:36.145ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68732024-12-12T22:38:36.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
68742024-12-12T22:38:36.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68752024-12-12T22:38:36.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68762024-12-12T22:38:36.161ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
68772024-12-12T22:38:36.161ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.148613ms iteration = 26 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
68782024-12-12T22:38:36.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 60.08982ms iteration = 26 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68792024-12-12T22:38:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1086 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = acec344e-0258-479a-b5b8-3cdc2ab85688 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
68802024-12-12T22:38:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 27 reason = Timeout
68812024-12-12T22:38:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 27 reason = Timeout
68822024-12-12T22:38:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68832024-12-12T22:38:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68842024-12-12T22:38:46.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68852024-12-12T22:38:46.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68862024-12-12T22:38:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68872024-12-12T22:38:46.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
68882024-12-12T22:38:46.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
68892024-12-12T22:38:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
68902024-12-12T22:38:46.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68912024-12-12T22:38:46.110ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.882686ms iteration = 27 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
68922024-12-12T22:38:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68932024-12-12T22:38:46.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68942024-12-12T22:38:46.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68952024-12-12T22:38:46.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
68962024-12-12T22:38:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
68972024-12-12T22:38:46.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
68982024-12-12T22:38:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
68992024-12-12T22:38:46.124ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
69002024-12-12T22:38:46.124ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 18.876411ms iteration = 27 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
69012024-12-12T22:38:47.179ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:37758
69022024-12-12T22:38:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 65e08415-dafa-4b83-82ae-a8d4e4d6c824 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
69032024-12-12T22:38:47.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 65e08415-dafa-4b83-82ae-a8d4e4d6c824 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
69042024-12-12T22:38:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3025 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 65e08415-dafa-4b83-82ae-a8d4e4d6c824 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
69052024-12-12T22:38:47.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 52197bba-1894-41b2-94c8-98c9922cc744 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
69062024-12-12T22:38:47.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 52197bba-1894-41b2-94c8-98c9922cc744 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
69072024-12-12T22:38:47.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 52197bba-1894-41b2-94c8-98c9922cc744 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
69082024-12-12T22:38:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1192 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 7e9b985a-2eb0-4648-a850-34d891a7889d response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
69092024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 10 reason = Timeout
69102024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 10 reason = Timeout
69112024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69122024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69132024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 28 reason = Timeout
69142024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 10 reason = Timeout
69152024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69162024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 11 reason = Timeout
69172024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 10 reason = Timeout
69182024-12-12T22:38:56.104ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
69192024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 10 reason = Timeout
69202024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69212024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
69222024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
69232024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 28 reason = Timeout
69242024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
69252024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 12 reason = Timeout
69262024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 10 reason = Timeout
69272024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69282024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
69292024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
69302024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 10 reason = Timeout
69312024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69322024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 10 reason = Timeout
69332024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
69342024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 10 reason = Timeout
69352024-12-12T22:38:56.104ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
69362024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69372024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69382024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69392024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69402024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
69412024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
69422024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69432024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69442024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
69452024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
69462024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
69472024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
69482024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 10 reason = Timeout
69492024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 10 reason = Timeout
69502024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 10 reason = Timeout
69512024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
69522024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
69532024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
69542024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 10 reason = Timeout
69552024-12-12T22:38:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
69562024-12-12T22:38:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
69572024-12-12T22:38:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
69582024-12-12T22:38:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
69592024-12-12T22:38:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
69602024-12-12T22:38:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69612024-12-12T22:38:56.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69622024-12-12T22:38:56.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69632024-12-12T22:38:56.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.487598ms iteration = 10 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
69642024-12-12T22:38:56.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69652024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
69662024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
69672024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69682024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69692024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
69702024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69712024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
69722024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
69732024-12-12T22:38:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
69742024-12-12T22:38:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
69752024-12-12T22:38:56.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69762024-12-12T22:38:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69772024-12-12T22:38:56.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69782024-12-12T22:38:56.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69792024-12-12T22:38:56.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
69802024-12-12T22:38:56.114ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
69812024-12-12T22:38:56.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
69822024-12-12T22:38:56.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3667, tv_nsec: 36502914 } })
69832024-12-12T22:38:56.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
69842024-12-12T22:38:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
69852024-12-12T22:38:56.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
69862024-12-12T22:38:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
69872024-12-12T22:38:56.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3667, tv_nsec: 38395082 } })
69882024-12-12T22:38:56.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
69892024-12-12T22:38:56.117ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 11.171259ms iteration = 10 status = {"errors":[],"garbage_collect_requested":[]}
69902024-12-12T22:38:56.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69912024-12-12T22:38:56.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3667, tv_nsec: 42343939 } })
69922024-12-12T22:38:56.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
69932024-12-12T22:38:56.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
69942024-12-12T22:38:56.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
69952024-12-12T22:38:56.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
69962024-12-12T22:38:56.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
69972024-12-12T22:38:56.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
69982024-12-12T22:38:56.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
69992024-12-12T22:38:56.123ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
70002024-12-12T22:38:56.123ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 18.80913ms iteration = 10 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
70012024-12-12T22:38:56.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70022024-12-12T22:38:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70032024-12-12T22:38:56.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70042024-12-12T22:38:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
70052024-12-12T22:38:56.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
70062024-12-12T22:38:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
70072024-12-12T22:38:56.126ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70082024-12-12T22:38:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70092024-12-12T22:38:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
70102024-12-12T22:38:56.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
70112024-12-12T22:38:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
70122024-12-12T22:38:56.141ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70132024-12-12T22:38:56.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70142024-12-12T22:38:56.150ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70152024-12-12T22:38:56.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70162024-12-12T22:38:56.152ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70172024-12-12T22:38:56.153ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
70182024-12-12T22:38:56.153ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 48.423391ms iteration = 28 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
70192024-12-12T22:38:56.154ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70202024-12-12T22:38:56.154ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70212024-12-12T22:38:56.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70222024-12-12T22:38:56.159ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70232024-12-12T22:38:56.159ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
70242024-12-12T22:38:56.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70252024-12-12T22:38:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70262024-12-12T22:38:56.159ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
70272024-12-12T22:38:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
70282024-12-12T22:38:56.160ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
70292024-12-12T22:38:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
70302024-12-12T22:38:56.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
70312024-12-12T22:38:56.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70322024-12-12T22:38:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
70332024-12-12T22:38:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70342024-12-12T22:38:56.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 60.400666ms iteration = 10 status = {"errors":[],"records_set_to_done":[]}
70352024-12-12T22:38:56.229ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 124.71884ms iteration = 12 status = {"physical_disks_added":0}
70362024-12-12T22:38:56.244ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70372024-12-12T22:38:56.244ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70382024-12-12T22:38:56.245ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3e07c01-9307-4aa8-ad5b-e6a9dc559b73", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
70392024-12-12T22:38:56.245ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70402024-12-12T22:38:56.246ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70412024-12-12T22:38:56.265ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70422024-12-12T22:38:56.265ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70432024-12-12T22:38:56.268ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
70442024-12-12T22:38:56.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70452024-12-12T22:38:56.268ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab6e97c-3965-4586-af10-65806e0c81bc", "content-length": "372", "date": "Thu, 12 Dec 2024 22:38:55 GMT"} })
70462024-12-12T22:38:56.268ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70472024-12-12T22:38:56.268ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70482024-12-12T22:38:56.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 166.313087ms iteration = 10 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
70492024-12-12T22:38:56.271ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 165.692684ms iteration = 10 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
70502024-12-12T22:38:56.273ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70512024-12-12T22:38:56.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70522024-12-12T22:38:56.274ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70532024-12-12T22:38:56.277ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
70542024-12-12T22:38:56.277ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
70552024-12-12T22:38:56.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
70562024-12-12T22:38:56.279ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 174.904465ms iteration = 10 status = 0
70572024-12-12T22:38:56.304ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 199.371286ms iteration = 28 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
70582024-12-12T22:38:56.304ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
70592024-12-12T22:38:56.304ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
70602024-12-12T22:38:56.305ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
70612024-12-12T22:38:56.305ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70622024-12-12T22:38:56.305ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
70632024-12-12T22:38:56.305ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
70642024-12-12T22:38:56.306ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
70652024-12-12T22:38:56.306ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
70662024-12-12T22:38:56.306ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
70672024-12-12T22:38:56.307ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
70682024-12-12T22:38:56.318ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
70692024-12-12T22:38:56.318ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
70702024-12-12T22:38:56.319ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "66a02d19-aaab-4cd4-85d8-157278ad2731", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
70712024-12-12T22:38:56.319ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70722024-12-12T22:38:56.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70732024-12-12T22:38:56.319ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
70742024-12-12T22:38:56.319ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70752024-12-12T22:38:56.320ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "2654f149-6be2-4094-8479-38fb838fce17", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
70762024-12-12T22:38:56.320ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70772024-12-12T22:38:56.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70782024-12-12T22:38:56.321ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70792024-12-12T22:38:56.322ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
70802024-12-12T22:38:56.324ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
70812024-12-12T22:38:56.324ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
70822024-12-12T22:38:56.327ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
70832024-12-12T22:38:56.327ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
70842024-12-12T22:38:56.327ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "572c8546-21dd-41e2-ae08-1758cbedfd2c", "content-length": "26", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
70852024-12-12T22:38:56.327ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
70862024-12-12T22:38:56.328ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
70872024-12-12T22:38:56.328ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
70882024-12-12T22:38:56.328ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
70892024-12-12T22:38:56.329ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "6d3b3803-0542-48ff-aa01-cba5816c8876", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
70902024-12-12T22:38:56.330ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 226.005778ms iteration = 11 status = {}
70912024-12-12T22:38:56.339ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 233.581148ms iteration = 10 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
70922024-12-12T22:38:56.341ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
70932024-12-12T22:38:56.341ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
70942024-12-12T22:38:56.341ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 236.548025ms iteration = 10 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
70952024-12-12T22:38:56.353ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
70962024-12-12T22:38:56.353ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "3d57c9c3-7cdf-40a4-a19b-06fd4f69d1d7", "content-length": "1", "date": "Thu, 12 Dec 2024 22:38:55 GMT"} })
70972024-12-12T22:38:56.355ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
70982024-12-12T22:38:56.355ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
70992024-12-12T22:38:56.358ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 253.393846ms iteration = 10 status = null
71002024-12-12T22:38:56.459ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
71012024-12-12T22:38:56.460ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "e65915e3-dec9-439c-aaba-e0592dbeb369", "content-length": "691", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71022024-12-12T22:38:56.460ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
71032024-12-12T22:38:56.460ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
71042024-12-12T22:38:56.460ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
71052024-12-12T22:38:56.461ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 356.686586ms iteration = 10 status = {}
71062024-12-12T22:38:56.496ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 391.877127ms iteration = 10 status = {}
71072024-12-12T22:38:56.552ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71082024-12-12T22:38:56.553ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71092024-12-12T22:38:56.555ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
71102024-12-12T22:38:56.555ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71112024-12-12T22:38:56.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71122024-12-12T22:38:56.565ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
71132024-12-12T22:38:56.566ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaeb8f3d-61e1-4d60-9c70-dd23dc661e58", "content-length": "134", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71142024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
71152024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
71162024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
71172024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
71182024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71192024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71202024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71212024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71222024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
71232024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
71242024-12-12T22:38:56.566ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
71252024-12-12T22:38:56.566ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71262024-12-12T22:38:56.567ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71272024-12-12T22:38:56.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
71282024-12-12T22:38:56.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7a032261-d02f-427e-8251-85bd6eda8c85", "content-length": "2", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71292024-12-12T22:38:56.568ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
71302024-12-12T22:38:56.568ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3dec134e-fb39-4846-aa6b-f9e125e5c0f3", "content-length": "52", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71312024-12-12T22:38:56.568ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
71322024-12-12T22:38:56.568ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
71332024-12-12T22:38:56.660ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05fd3a39-7207-4a6d-8e46-8dd718bde7bc", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71342024-12-12T22:38:56.660ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
71352024-12-12T22:38:56.660ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
71362024-12-12T22:38:56.660ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5d1f9fb3-a26b-4459-93e8-0aa8134b9c60", "content-length": "682", "date": "Thu, 12 Dec 2024 22:38:56 GMT"} })
71372024-12-12T22:38:56.660ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71382024-12-12T22:38:56.661ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71392024-12-12T22:38:56.665ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71402024-12-12T22:38:56.665ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71412024-12-12T22:38:56.669ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71422024-12-12T22:38:56.669ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71432024-12-12T22:38:56.671ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
71442024-12-12T22:38:56.671ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
71452024-12-12T22:38:56.679ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 574.8355ms iteration = 10 status = {}
71462024-12-12T22:38:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1023 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 582abaa4-f8e8-4c61-b90b-ac8c6069526e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
71472024-12-12T22:39:02.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 1a868aed-a9f0-456b-8a38-b75e8fce49a5 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
71482024-12-12T22:39:02.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 1a868aed-a9f0-456b-8a38-b75e8fce49a5 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
71492024-12-12T22:39:02.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3256 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 1a868aed-a9f0-456b-8a38-b75e8fce49a5 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
71502024-12-12T22:39:02.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 4c71373e-b514-4acc-b586-5b4e823ffccb roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
71512024-12-12T22:39:02.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 4c71373e-b514-4acc-b586-5b4e823ffccb resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
71522024-12-12T22:39:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2638 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:37758 req_id = 4c71373e-b514-4acc-b586-5b4e823ffccb response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
71532024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 29 reason = Timeout
71542024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71552024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 29 reason = Timeout
71562024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71572024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71582024-12-12T22:39:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71592024-12-12T22:39:06.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71602024-12-12T22:39:06.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71612024-12-12T22:39:06.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.735864ms iteration = 29 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71622024-12-12T22:39:06.135ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71632024-12-12T22:39:06.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71642024-12-12T22:39:06.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71652024-12-12T22:39:06.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71662024-12-12T22:39:06.140ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71672024-12-12T22:39:06.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71682024-12-12T22:39:06.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71692024-12-12T22:39:06.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
71702024-12-12T22:39:06.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71712024-12-12T22:39:06.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71722024-12-12T22:39:06.155ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
71732024-12-12T22:39:06.155ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.590474ms iteration = 29 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
71742024-12-12T22:39:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1236 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 5bcbee58-a501-478f-8113-1bff41fb5c6e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
71752024-12-12T22:39:16.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 30 reason = Timeout
71762024-12-12T22:39:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 30 reason = Timeout
71772024-12-12T22:39:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71782024-12-12T22:39:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71792024-12-12T22:39:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71802024-12-12T22:39:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71812024-12-12T22:39:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71822024-12-12T22:39:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
71832024-12-12T22:39:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71842024-12-12T22:39:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71852024-12-12T22:39:16.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71862024-12-12T22:39:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71872024-12-12T22:39:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
71882024-12-12T22:39:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
71892024-12-12T22:39:16.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
71902024-12-12T22:39:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
71912024-12-12T22:39:16.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
71922024-12-12T22:39:16.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.130406ms iteration = 30 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
71932024-12-12T22:39:16.137ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
71942024-12-12T22:39:16.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
71952024-12-12T22:39:16.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 64.590019ms iteration = 30 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
71962024-12-12T22:39:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1244 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 416abbbd-8ce5-4739-8a4b-971e3c6d798f response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
71972024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 11 reason = Timeout
71982024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 8 reason = Timeout
71992024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
72002024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 6 reason = Timeout
72012024-12-12T22:39:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
72022024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 31 reason = Timeout
72032024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72042024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
72052024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 8 reason = Timeout
72062024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 11 reason = Timeout
72072024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 11 reason = Timeout
72082024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
72092024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 11 reason = Timeout
72102024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
72112024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
72122024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 11 reason = Timeout
72132024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 13 reason = Timeout
72142024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
72152024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 11 reason = Timeout
72162024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
72172024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
72182024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 11 reason = Timeout
72192024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 6 reason = Timeout
72202024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
72212024-12-12T22:39:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:29:26.105337597 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
72222024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 6 reason = Timeout
72232024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
72242024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
72252024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 11 reason = Timeout
72262024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 7 reason = Timeout
72272024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
72282024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
72292024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
72302024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 12 reason = Timeout
72312024-12-12T22:39:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
72322024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
72332024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 31 reason = Timeout
72342024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
72352024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 11 reason = Timeout
72362024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
72372024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 7 reason = Timeout
72382024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 7 reason = Timeout
72392024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
72402024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 7 reason = Timeout
72412024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 7 reason = Timeout
72422024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
72432024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
72442024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 7 reason = Timeout
72452024-12-12T22:39:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
72462024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 13.95\u{b5}s iteration = 7 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
72472024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 2 reason = Timeout
72482024-12-12T22:39:26.105ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
72492024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
72502024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 6 reason = Timeout
72512024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 11 reason = Timeout
72522024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
72532024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
72542024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 11 reason = Timeout
72552024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
72562024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 11 reason = Timeout
72572024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
72582024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 6 reason = Timeout
72592024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 11 reason = Timeout
72602024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
72612024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
72622024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
72632024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
72642024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72652024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
72662024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
72672024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
72682024-12-12T22:39:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
72692024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
72702024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
72712024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
72722024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
72732024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
72742024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
72752024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
72762024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
72772024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
72782024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
72792024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
72802024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
72812024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
72822024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
72832024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
72842024-12-12T22:39:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3697, tv_nsec: 27901840 } })
72852024-12-12T22:39:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3697, tv_nsec: 27902570 } })
72862024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
72872024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
72882024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
72892024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
72902024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.222524ms iteration = 7 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
72912024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
72922024-12-12T22:39:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.290776ms iteration = 7 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
72932024-12-12T22:39:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.292765ms iteration = 11 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
72942024-12-12T22:39:26.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72952024-12-12T22:39:26.108ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72962024-12-12T22:39:26.109ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
72972024-12-12T22:39:26.109ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
72982024-12-12T22:39:26.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
72992024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
73002024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
73012024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
73022024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
73032024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
73042024-12-12T22:39:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73052024-12-12T22:39:26.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73062024-12-12T22:39:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
73072024-12-12T22:39:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73082024-12-12T22:39:26.114ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73092024-12-12T22:39:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73102024-12-12T22:39:26.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3697, tv_nsec: 36548100 } })
73112024-12-12T22:39:26.115ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
73122024-12-12T22:39:26.116ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3697, tv_nsec: 38400756 } })
73132024-12-12T22:39:26.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73142024-12-12T22:39:26.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
73152024-12-12T22:39:26.117ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:29:26.105337597 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
73162024-12-12T22:39:26.117ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 11.846233ms iteration = 6 status = {"expiration":"2024-12-12T22:29:26.105337597Z","pruned":[]}
73172024-12-12T22:39:26.117ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
73182024-12-12T22:39:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
73192024-12-12T22:39:26.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
73202024-12-12T22:39:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
73212024-12-12T22:39:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
73222024-12-12T22:39:26.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73232024-12-12T22:39:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73242024-12-12T22:39:26.122ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73252024-12-12T22:39:26.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73262024-12-12T22:39:26.123ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 18.367601ms iteration = 6 status = {"errors":[],"found_port_ok":[]}
73272024-12-12T22:39:26.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 18.81176ms iteration = 11 status = {"errors":[],"records_set_to_done":[]}
73282024-12-12T22:39:26.126ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73292024-12-12T22:39:26.126ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3697, tv_nsec: 48687938 } })
73302024-12-12T22:39:26.127ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
73312024-12-12T22:39:26.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73322024-12-12T22:39:26.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73332024-12-12T22:39:26.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73342024-12-12T22:39:26.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73352024-12-12T22:39:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73362024-12-12T22:39:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73372024-12-12T22:39:26.131ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
73382024-12-12T22:39:26.131ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
73392024-12-12T22:39:26.131ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
73402024-12-12T22:39:26.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73412024-12-12T22:39:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73422024-12-12T22:39:26.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73432024-12-12T22:39:26.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73442024-12-12T22:39:26.132ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
73452024-12-12T22:39:26.135ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73462024-12-12T22:39:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
73472024-12-12T22:39:26.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
73482024-12-12T22:39:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
73492024-12-12T22:39:26.138ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
73502024-12-12T22:39:26.138ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
73512024-12-12T22:39:26.139ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73522024-12-12T22:39:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73532024-12-12T22:39:26.143ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73542024-12-12T22:39:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73552024-12-12T22:39:26.146ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
73562024-12-12T22:39:26.146ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
73572024-12-12T22:39:26.146ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73582024-12-12T22:39:26.146ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73592024-12-12T22:39:26.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73602024-12-12T22:39:26.153ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
73612024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
73622024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
73632024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
73642024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
73652024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
73662024-12-12T22:39:26.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
73672024-12-12T22:39:26.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73682024-12-12T22:39:26.159ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
73692024-12-12T22:39:26.159ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
73702024-12-12T22:39:26.159ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
73712024-12-12T22:39:26.159ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 53.744166ms iteration = 7 status = {"generation":1}
73722024-12-12T22:39:26.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73732024-12-12T22:39:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
73742024-12-12T22:39:26.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73752024-12-12T22:39:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73762024-12-12T22:39:26.161ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73772024-12-12T22:39:26.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
73782024-12-12T22:39:26.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
73792024-12-12T22:39:26.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
73802024-12-12T22:39:26.164ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73812024-12-12T22:39:26.164ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73822024-12-12T22:39:26.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73832024-12-12T22:39:26.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
73842024-12-12T22:39:26.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
73852024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
73862024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73872024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
73882024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
73892024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
73902024-12-12T22:39:26.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
73912024-12-12T22:39:26.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
73922024-12-12T22:39:26.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
73932024-12-12T22:39:26.168ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
73942024-12-12T22:39:26.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 63.228712ms iteration = 11 status = {"errors":[],"garbage_collect_requested":[]}
73952024-12-12T22:39:26.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
73962024-12-12T22:39:26.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
73972024-12-12T22:39:26.170ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
73982024-12-12T22:39:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
73992024-12-12T22:39:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
74002024-12-12T22:39:26.172ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
74012024-12-12T22:39:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
74022024-12-12T22:39:26.173ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
74032024-12-12T22:39:26.173ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
74042024-12-12T22:39:26.173ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 68.063047ms iteration = 6 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
74052024-12-12T22:39:26.175ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 69.936943ms iteration = 31 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
74062024-12-12T22:39:26.175ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
74072024-12-12T22:39:26.175ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74082024-12-12T22:39:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
74092024-12-12T22:39:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74102024-12-12T22:39:26.176ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74112024-12-12T22:39:26.177ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
74122024-12-12T22:39:26.177ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
74132024-12-12T22:39:26.177ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 72.282349ms iteration = 6 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
74142024-12-12T22:39:26.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74152024-12-12T22:39:26.178ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74162024-12-12T22:39:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74172024-12-12T22:39:26.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74182024-12-12T22:39:26.184ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74192024-12-12T22:39:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74202024-12-12T22:39:26.186ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74212024-12-12T22:39:26.187ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
74222024-12-12T22:39:26.187ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
74232024-12-12T22:39:26.187ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
74242024-12-12T22:39:26.187ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74252024-12-12T22:39:26.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74262024-12-12T22:39:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
74272024-12-12T22:39:26.189ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
74282024-12-12T22:39:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
74292024-12-12T22:39:26.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74302024-12-12T22:39:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
74312024-12-12T22:39:26.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74322024-12-12T22:39:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74332024-12-12T22:39:26.192ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74342024-12-12T22:39:26.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74352024-12-12T22:39:26.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74362024-12-12T22:39:26.194ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 89.204262ms iteration = 11 status = 0
74372024-12-12T22:39:26.196ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74382024-12-12T22:39:26.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74392024-12-12T22:39:26.196ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74402024-12-12T22:39:26.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74412024-12-12T22:39:26.197ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
74422024-12-12T22:39:26.197ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 92.380224ms iteration = 31 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
74432024-12-12T22:39:26.198ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74442024-12-12T22:39:26.202ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
74452024-12-12T22:39:26.202ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
74462024-12-12T22:39:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
74472024-12-12T22:39:26.203ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74482024-12-12T22:39:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74492024-12-12T22:39:26.211ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
74502024-12-12T22:39:26.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
74512024-12-12T22:39:26.214ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74522024-12-12T22:39:26.214ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
74532024-12-12T22:39:26.214ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
74542024-12-12T22:39:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
74552024-12-12T22:39:26.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 120.15677ms iteration = 11 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
74562024-12-12T22:39:26.225ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 120.568298ms iteration = 11 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
74572024-12-12T22:39:26.226ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 121.346813ms iteration = 11 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
74582024-12-12T22:39:26.227ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
74592024-12-12T22:39:26.229ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
74602024-12-12T22:39:26.229ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 123.685969ms iteration = 11 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
74612024-12-12T22:39:26.234ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
74622024-12-12T22:39:26.234ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
74632024-12-12T22:39:26.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74642024-12-12T22:39:26.234ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74652024-12-12T22:39:26.239ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74662024-12-12T22:39:26.239ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74672024-12-12T22:39:26.240ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3ce44856-75f1-4139-9c2c-5f64175c0afa", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
74682024-12-12T22:39:26.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74692024-12-12T22:39:26.242ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74702024-12-12T22:39:26.243ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
74712024-12-12T22:39:26.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74722024-12-12T22:39:26.250ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
74732024-12-12T22:39:26.250ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 145.14789ms iteration = 7 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
74742024-12-12T22:39:26.251ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
74752024-12-12T22:39:26.251ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
74762024-12-12T22:39:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
74772024-12-12T22:39:26.253ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
74782024-12-12T22:39:26.253ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
74792024-12-12T22:39:26.253ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 148.015197ms iteration = 11 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
74802024-12-12T22:39:26.270ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
74812024-12-12T22:39:26.270ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74822024-12-12T22:39:26.270ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "3c14cf0c-aabf-402b-9530-f3f0e96e5448", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
74832024-12-12T22:39:26.270ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74842024-12-12T22:39:26.272ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
74852024-12-12T22:39:26.277ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
74862024-12-12T22:39:26.280ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
74872024-12-12T22:39:26.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
74882024-12-12T22:39:26.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
74892024-12-12T22:39:26.287ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 182.337811ms iteration = 13 status = {"physical_disks_added":0}
74902024-12-12T22:39:26.293ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
74912024-12-12T22:39:26.293ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
74922024-12-12T22:39:26.297ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
74932024-12-12T22:39:26.297ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
74942024-12-12T22:39:26.298ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03cb6c03-2ffc-4260-a58c-2cc242bbb9a1", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} })
74952024-12-12T22:39:26.298ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
74962024-12-12T22:39:26.299ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
74972024-12-12T22:39:26.322ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
74982024-12-12T22:39:26.322ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 217.149945ms iteration = 6 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
74992024-12-12T22:39:26.400ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
75002024-12-12T22:39:26.400ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "937a4120-363a-4bc2-8a54-a6b24cb9b4d3", "content-length": "1", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
75012024-12-12T22:39:26.400ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
75022024-12-12T22:39:26.401ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
75032024-12-12T22:39:26.402ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "919a72f9-e714-416f-a016-50dcb2bf20f1", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75042024-12-12T22:39:26.402ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75052024-12-12T22:39:26.402ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
75062024-12-12T22:39:26.402ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
75072024-12-12T22:39:26.404ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b255df61-3ab6-4536-879a-23ed63b22a95", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75082024-12-12T22:39:26.404ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75092024-12-12T22:39:26.406ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
75102024-12-12T22:39:26.406ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 300.972851ms iteration = 8 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
75112024-12-12T22:39:26.411ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
75122024-12-12T22:39:26.411ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
75132024-12-12T22:39:26.411ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "3725a50a-d802-4d3c-b12b-e311c449fd74", "content-length": "372", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
75142024-12-12T22:39:26.411ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
75152024-12-12T22:39:26.411ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
75162024-12-12T22:39:26.412ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75172024-12-12T22:39:26.412ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75182024-12-12T22:39:26.413ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
75192024-12-12T22:39:26.413ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
75202024-12-12T22:39:26.413ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
75212024-12-12T22:39:26.413ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 308.119762ms iteration = 7 status = {"generation":2}
75222024-12-12T22:39:26.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75232024-12-12T22:39:26.414ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 309.376986ms iteration = 11 status = null
75242024-12-12T22:39:26.415ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75252024-12-12T22:39:26.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75262024-12-12T22:39:26.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75272024-12-12T22:39:26.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75282024-12-12T22:39:26.416ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75292024-12-12T22:39:26.417ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75302024-12-12T22:39:26.417ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75312024-12-12T22:39:26.419ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
75322024-12-12T22:39:26.419ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
75332024-12-12T22:39:26.419ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
75342024-12-12T22:39:26.420ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 315.087259ms iteration = 11 status = {}
75352024-12-12T22:39:26.423ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
75362024-12-12T22:39:26.424ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75372024-12-12T22:39:26.424ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75382024-12-12T22:39:26.426ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75392024-12-12T22:39:26.426ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75402024-12-12T22:39:26.428ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75412024-12-12T22:39:26.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75422024-12-12T22:39:26.430ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75432024-12-12T22:39:26.430ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75442024-12-12T22:39:26.432ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75452024-12-12T22:39:26.432ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75462024-12-12T22:39:26.434ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75472024-12-12T22:39:26.434ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75482024-12-12T22:39:26.435ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75492024-12-12T22:39:26.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75502024-12-12T22:39:26.437ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75512024-12-12T22:39:26.443ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
75522024-12-12T22:39:26.443ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75532024-12-12T22:39:26.444ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75542024-12-12T22:39:26.445ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75552024-12-12T22:39:26.446ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75562024-12-12T22:39:26.447ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75572024-12-12T22:39:26.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75582024-12-12T22:39:26.450ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75592024-12-12T22:39:26.450ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75602024-12-12T22:39:26.452ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75612024-12-12T22:39:26.452ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75622024-12-12T22:39:26.453ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
75632024-12-12T22:39:26.453ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "6f67c734-c724-40ff-89a0-0a893b1f9bef", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75642024-12-12T22:39:26.453ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75652024-12-12T22:39:26.454ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75662024-12-12T22:39:26.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75672024-12-12T22:39:26.457ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "1c6832f7-6d01-4301-9134-3d0692ae337a", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75682024-12-12T22:39:26.457ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75692024-12-12T22:39:26.458ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75702024-12-12T22:39:26.458ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75712024-12-12T22:39:26.459ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "bcc846e9-3335-4457-ab20-9c7cca3afef5", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75722024-12-12T22:39:26.459ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75732024-12-12T22:39:26.461ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
75742024-12-12T22:39:26.461ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 356.366779ms iteration = 8 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
75752024-12-12T22:39:26.478ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
75762024-12-12T22:39:26.478ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
75772024-12-12T22:39:26.488ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75782024-12-12T22:39:26.492ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75792024-12-12T22:39:26.492ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75802024-12-12T22:39:26.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75812024-12-12T22:39:26.494ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75822024-12-12T22:39:26.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75832024-12-12T22:39:26.495ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75842024-12-12T22:39:26.496ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75852024-12-12T22:39:26.497ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
75862024-12-12T22:39:26.498ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75872024-12-12T22:39:26.499ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75882024-12-12T22:39:26.501ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
75892024-12-12T22:39:26.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
75902024-12-12T22:39:26.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
75912024-12-12T22:39:26.501ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
75922024-12-12T22:39:26.501ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75932024-12-12T22:39:26.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75942024-12-12T22:39:26.506ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75952024-12-12T22:39:26.506ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75962024-12-12T22:39:26.507ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75972024-12-12T22:39:26.507ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
75982024-12-12T22:39:26.509ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
75992024-12-12T22:39:26.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76002024-12-12T22:39:26.510ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
76012024-12-12T22:39:26.511ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e7a26b9e-eec2-4fae-8620-5c7e8400157a", "content-length": "134", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76022024-12-12T22:39:26.511ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
76032024-12-12T22:39:26.511ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
76042024-12-12T22:39:26.511ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76052024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
76062024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
76072024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76082024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76092024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76102024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76112024-12-12T22:39:26.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76122024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
76132024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
76142024-12-12T22:39:26.512ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
76152024-12-12T22:39:26.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76162024-12-12T22:39:26.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76172024-12-12T22:39:26.514ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76182024-12-12T22:39:26.514ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76192024-12-12T22:39:26.514ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
76202024-12-12T22:39:26.514ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "6fe4d090-2395-4867-aae2-6ca053a0ec60", "content-length": "2", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76212024-12-12T22:39:26.515ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
76222024-12-12T22:39:26.515ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "d2a74f8f-e7de-4173-8989-a92d68315f1f", "content-length": "52", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76232024-12-12T22:39:26.515ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
76242024-12-12T22:39:26.515ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
76252024-12-12T22:39:26.516ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76262024-12-12T22:39:26.516ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76272024-12-12T22:39:26.517ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76282024-12-12T22:39:26.518ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76292024-12-12T22:39:26.519ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76302024-12-12T22:39:26.523ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
76312024-12-12T22:39:26.523ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76322024-12-12T22:39:26.523ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76332024-12-12T22:39:26.524ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76342024-12-12T22:39:26.524ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76352024-12-12T22:39:26.526ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76362024-12-12T22:39:26.526ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76372024-12-12T22:39:26.527ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76382024-12-12T22:39:26.529ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
76392024-12-12T22:39:26.531ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
76402024-12-12T22:39:26.531ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76412024-12-12T22:39:26.531ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76422024-12-12T22:39:26.538ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
76432024-12-12T22:39:26.539ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76442024-12-12T22:39:26.539ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76452024-12-12T22:39:26.540ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76462024-12-12T22:39:26.541ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
76472024-12-12T22:39:26.541ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76482024-12-12T22:39:26.542ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76492024-12-12T22:39:26.543ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
76502024-12-12T22:39:26.544ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
76512024-12-12T22:39:26.544ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
76522024-12-12T22:39:26.578ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "87f2e668-276c-4504-932a-ee4bb5d1a60c", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76532024-12-12T22:39:26.578ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76542024-12-12T22:39:26.579ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76552024-12-12T22:39:26.581ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76562024-12-12T22:39:26.581ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76572024-12-12T22:39:26.582ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "bf053888-64ed-4b2d-acdf-47749d7550ff", "content-length": "691", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} })
76582024-12-12T22:39:26.582ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
76592024-12-12T22:39:26.582ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
76602024-12-12T22:39:26.582ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
76612024-12-12T22:39:26.584ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 479.035439ms iteration = 11 status = {}
76622024-12-12T22:39:26.584ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
76632024-12-12T22:39:26.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
76642024-12-12T22:39:26.589ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
76652024-12-12T22:39:26.589ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
76662024-12-12T22:39:26.589ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ad8d1cca-2d3b-46d6-9715-8f2a10c651a5", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} })
76672024-12-12T22:39:26.590ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 485.362702ms iteration = 12 status = {}
76682024-12-12T22:39:26.673ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 4a8c9490-d35a-4221-8585-e4103b325118, time_created: 2024-12-12T22:34:36.929491Z, time_modified: 2024-12-12T22:34:36.929491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
76692024-12-12T22:39:26.673ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
76702024-12-12T22:39:26.673ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76712024-12-12T22:39:26.673ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76722024-12-12T22:39:26.675ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
76732024-12-12T22:39:26.675ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
76742024-12-12T22:39:26.677ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
76752024-12-12T22:39:26.679ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "1432a6c6-7bd9-4796-957b-faf1cc083f15", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76762024-12-12T22:39:26.679ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
76772024-12-12T22:39:26.679ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
76782024-12-12T22:39:26.679ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d7749ec-527e-4cbf-aceb-de5687096278", "content-length": "682", "date": "Thu, 12 Dec 2024 22:39:26 GMT"} })
76792024-12-12T22:39:26.679ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76802024-12-12T22:39:26.680ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76812024-12-12T22:39:26.680ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
76822024-12-12T22:39:26.684ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76832024-12-12T22:39:26.684ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76842024-12-12T22:39:26.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76852024-12-12T22:39:26.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76862024-12-12T22:39:26.690ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
76872024-12-12T22:39:26.690ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
76882024-12-12T22:39:26.697ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 592.482126ms iteration = 11 status = {}
76892024-12-12T22:39:26.710ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
76902024-12-12T22:39:26.711ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "aed03f97-134e-4681-bd1f-4c12a2cb229e", "date": "Thu, 12 Dec 2024 22:39:25 GMT"} })
76912024-12-12T22:39:26.713ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
76922024-12-12T22:39:26.713ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 608.056783ms
76932024-12-12T22:39:26.713ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 608.066133ms iteration = 2 status = {}
76942024-12-12T22:39:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1070 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = a82ace00-d33b-4042-a0f7-b48367e1fa10 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
76952024-12-12T22:39:33.501ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34623
76962024-12-12T22:39:33.501ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34623 req_id = 30bc3e2c-495a-4bc5-8085-0ad0c14df363 roles = RoleSet { roles: {} } uri = /metrics/producers
76972024-12-12T22:39:33.501ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34623 req_id = 30bc3e2c-495a-4bc5-8085-0ad0c14df363 resource = Database result = Ok(()) uri = /metrics/producers
76982024-12-12T22:39:33.544ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = bb9dca28-dea1-4105-b015-9af4a5ccce7e
76992024-12-12T22:39:33.544ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43011 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34623 req_id = 30bc3e2c-495a-4bc5-8085-0ad0c14df363 response_code = 201 uri = /metrics/producers
77002024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 32 reason = Timeout
77012024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 32 reason = Timeout
77022024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77032024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77042024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77052024-12-12T22:39:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77062024-12-12T22:39:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77072024-12-12T22:39:36.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77082024-12-12T22:39:36.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77092024-12-12T22:39:36.109ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.831815ms iteration = 32 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77102024-12-12T22:39:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77112024-12-12T22:39:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77122024-12-12T22:39:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77132024-12-12T22:39:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77142024-12-12T22:39:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77152024-12-12T22:39:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77162024-12-12T22:39:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
77172024-12-12T22:39:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77182024-12-12T22:39:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77192024-12-12T22:39:36.129ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
77202024-12-12T22:39:36.129ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.221476ms iteration = 32 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
77212024-12-12T22:39:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1155 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 56e23ebd-e0af-493d-9f31-54c4c0a3fd2a response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
77222024-12-12T22:39:39.709ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
77232024-12-12T22:39:39.709ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
77242024-12-12T22:39:39.739ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
77252024-12-12T22:39:39.739ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:40813
77262024-12-12T22:39:39.739ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40813 req_id = 22c861bf-db8b-4bdb-b914-acdb3027184c roles = RoleSet { roles: {} } uri = /metrics/producers
77272024-12-12T22:39:39.740ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40813 req_id = 22c861bf-db8b-4bdb-b914-acdb3027184c resource = Database result = Ok(()) uri = /metrics/producers
77282024-12-12T22:39:39.792ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
77292024-12-12T22:39:39.792ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 52588 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:40813 req_id = 22c861bf-db8b-4bdb-b914-acdb3027184c response_code = 201 uri = /metrics/producers
77302024-12-12T22:39:39.792ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "22c861bf-db8b-4bdb-b914-acdb3027184c", "content-length": "41", "date": "Thu, 12 Dec 2024 22:39:39 GMT"} })
77312024-12-12T22:39:39.793ZDEBGnexus (producer-registration-task): registered with nexus successfully
77322024-12-12T22:39:39.793ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
77332024-12-12T22:39:46.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 33 reason = Timeout
77342024-12-12T22:39:46.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77352024-12-12T22:39:46.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 33 reason = Timeout
77362024-12-12T22:39:46.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77372024-12-12T22:39:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77382024-12-12T22:39:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77392024-12-12T22:39:46.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77402024-12-12T22:39:46.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77412024-12-12T22:39:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77422024-12-12T22:39:46.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.006608ms iteration = 33 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
77432024-12-12T22:39:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
77442024-12-12T22:39:46.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77452024-12-12T22:39:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77462024-12-12T22:39:46.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77472024-12-12T22:39:46.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77482024-12-12T22:39:46.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
77492024-12-12T22:39:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
77502024-12-12T22:39:46.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77512024-12-12T22:39:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77522024-12-12T22:39:46.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
77532024-12-12T22:39:46.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.690116ms iteration = 33 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
77542024-12-12T22:39:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1078 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 600e0564-6580-48c9-a0b0-dee93d5d5f8d response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
77552024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 12 reason = Timeout
77562024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 12 reason = Timeout
77572024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
77582024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 34 reason = Timeout
77592024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
77602024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
77612024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 34 reason = Timeout
77622024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 12 reason = Timeout
77632024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
77642024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 12 reason = Timeout
77652024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
77662024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 12 reason = Timeout
77672024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
77682024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 14 reason = Timeout
77692024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 13 reason = Timeout
77702024-12-12T22:39:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
77712024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
77722024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
77732024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 12 reason = Timeout
77742024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
77752024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
77762024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 12 reason = Timeout
77772024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
77782024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 12 reason = Timeout
77792024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
77802024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 12 reason = Timeout
77812024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
77822024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
77832024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
77842024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
77852024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
77862024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
77872024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
77882024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
77892024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
77902024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
77912024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
77922024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
77932024-12-12T22:39:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
77942024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 12 reason = Timeout
77952024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
77962024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 12 reason = Timeout
77972024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
77982024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 12 reason = Timeout
77992024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 12 reason = Timeout
78002024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
78012024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78022024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
78032024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
78042024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78052024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78062024-12-12T22:39:56.106ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 1.841856ms iteration = 12 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
78072024-12-12T22:39:56.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
78082024-12-12T22:39:56.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
78092024-12-12T22:39:56.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78102024-12-12T22:39:56.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78112024-12-12T22:39:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3727, tv_nsec: 31292519 } })
78122024-12-12T22:39:56.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78132024-12-12T22:39:56.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
78142024-12-12T22:39:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
78152024-12-12T22:39:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
78162024-12-12T22:39:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
78172024-12-12T22:39:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
78182024-12-12T22:39:56.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
78192024-12-12T22:39:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
78202024-12-12T22:39:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
78212024-12-12T22:39:56.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78222024-12-12T22:39:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78232024-12-12T22:39:56.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78242024-12-12T22:39:56.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78252024-12-12T22:39:56.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78262024-12-12T22:39:56.114ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78272024-12-12T22:39:56.114ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
78282024-12-12T22:39:56.114ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78292024-12-12T22:39:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78302024-12-12T22:39:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78312024-12-12T22:39:56.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78322024-12-12T22:39:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78332024-12-12T22:39:56.116ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78342024-12-12T22:39:56.116ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78352024-12-12T22:39:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78362024-12-12T22:39:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
78372024-12-12T22:39:56.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78382024-12-12T22:39:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78392024-12-12T22:39:56.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3727, tv_nsec: 39041082 } })
78402024-12-12T22:39:56.117ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
78412024-12-12T22:39:56.119ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 12.917474ms iteration = 12 status = {"errors":[],"records_set_to_done":[]}
78422024-12-12T22:39:56.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78432024-12-12T22:39:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78442024-12-12T22:39:56.122ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78452024-12-12T22:39:56.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78462024-12-12T22:39:56.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3727, tv_nsec: 44289274 } })
78472024-12-12T22:39:56.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
78482024-12-12T22:39:56.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78492024-12-12T22:39:56.123ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78502024-12-12T22:39:56.123ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
78512024-12-12T22:39:56.123ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
78522024-12-12T22:39:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78532024-12-12T22:39:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
78542024-12-12T22:39:56.123ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78552024-12-12T22:39:56.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78562024-12-12T22:39:56.124ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
78572024-12-12T22:39:56.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
78582024-12-12T22:39:56.125ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78592024-12-12T22:39:56.126ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
78602024-12-12T22:39:56.126ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 21.824119ms iteration = 12 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
78612024-12-12T22:39:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
78622024-12-12T22:39:56.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
78632024-12-12T22:39:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
78642024-12-12T22:39:56.149ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 44.670777ms iteration = 14 status = {"physical_disks_added":0}
78652024-12-12T22:39:56.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
78662024-12-12T22:39:56.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
78672024-12-12T22:39:56.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.854528ms iteration = 12 status = {"errors":[],"garbage_collect_requested":[]}
78682024-12-12T22:39:56.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 55.426268ms iteration = 12 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
78692024-12-12T22:39:56.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.054991ms iteration = 34 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
78702024-12-12T22:39:56.161ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78712024-12-12T22:39:56.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78722024-12-12T22:39:56.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78732024-12-12T22:39:56.163ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78742024-12-12T22:39:56.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
78752024-12-12T22:39:56.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78762024-12-12T22:39:56.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
78772024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
78782024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
78792024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78802024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
78812024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
78822024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
78832024-12-12T22:39:56.165ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
78842024-12-12T22:39:56.168ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
78852024-12-12T22:39:56.168ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
78862024-12-12T22:39:56.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
78872024-12-12T22:39:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
78882024-12-12T22:39:56.169ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
78892024-12-12T22:39:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
78902024-12-12T22:39:56.170ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 65.377114ms iteration = 12 status = 0
78912024-12-12T22:39:56.173ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
78922024-12-12T22:39:56.173ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
78932024-12-12T22:39:56.173ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 68.75754ms iteration = 12 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
78942024-12-12T22:39:56.178ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
78952024-12-12T22:39:56.178ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 73.458092ms iteration = 34 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
78962024-12-12T22:39:56.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.415185ms iteration = 12 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
78972024-12-12T22:39:56.200ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 93.808023ms iteration = 12 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
78982024-12-12T22:39:56.215ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
78992024-12-12T22:39:56.215ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79002024-12-12T22:39:56.216ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "fac56f01-1b36-4832-9e1b-49475a4dc0c3", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:55 GMT"} })
79012024-12-12T22:39:56.216ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79022024-12-12T22:39:56.218ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79032024-12-12T22:39:56.243ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79042024-12-12T22:39:56.243ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79052024-12-12T22:39:56.245ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79062024-12-12T22:39:56.247ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79072024-12-12T22:39:56.247ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79082024-12-12T22:39:56.247ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79092024-12-12T22:39:56.269ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
79102024-12-12T22:39:56.269ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79112024-12-12T22:39:56.269ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c71749ea-a132-44b3-86c5-c4ff25ad675b", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79122024-12-12T22:39:56.269ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79132024-12-12T22:39:56.271ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
79142024-12-12T22:39:56.290ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
79152024-12-12T22:39:56.290ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
79162024-12-12T22:39:56.290ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "99f14799-695d-4839-9153-0d3197a0de8a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79172024-12-12T22:39:56.290ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
79182024-12-12T22:39:56.292ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
79192024-12-12T22:39:56.389ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
79202024-12-12T22:39:56.389ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "d4b5010e-1014-4ac5-92f8-ba4603a60463", "content-length": "1", "date": "Thu, 12 Dec 2024 22:39:55 GMT"} })
79212024-12-12T22:39:56.391ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
79222024-12-12T22:39:56.391ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
79232024-12-12T22:39:56.432ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 326.991622ms iteration = 12 status = {}
79242024-12-12T22:39:56.432ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
79252024-12-12T22:39:56.432ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79262024-12-12T22:39:56.432ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "b9aedb92-62f4-4f55-b3ce-31bca5d39f5e", "content-length": "372", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79272024-12-12T22:39:56.432ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79282024-12-12T22:39:56.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79292024-12-12T22:39:56.434ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
79302024-12-12T22:39:56.434ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 329.491181ms iteration = 12 status = null
79312024-12-12T22:39:56.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
79322024-12-12T22:39:56.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
79332024-12-12T22:39:56.436ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
79342024-12-12T22:39:56.474ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
79352024-12-12T22:39:56.474ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
79362024-12-12T22:39:56.475ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "cb7c3800-7003-4e76-8c9c-f72c3d675a1a", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79372024-12-12T22:39:56.475ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79382024-12-12T22:39:56.475ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79392024-12-12T22:39:56.477ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79402024-12-12T22:39:56.477ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79412024-12-12T22:39:56.480ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
79422024-12-12T22:39:56.480ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
79432024-12-12T22:39:56.484ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
79442024-12-12T22:39:56.484ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
79452024-12-12T22:39:56.485ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8b62fe87-fec8-4f01-b48b-63427bad1676", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79462024-12-12T22:39:56.486ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 381.607434ms iteration = 13 status = {}
79472024-12-12T22:39:56.495ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
79482024-12-12T22:39:56.495ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "c03fd018-ce42-47de-963c-8e61ab9d5990", "content-length": "691", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79492024-12-12T22:39:56.495ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
79502024-12-12T22:39:56.495ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
79512024-12-12T22:39:56.495ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
79522024-12-12T22:39:56.497ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 392.213044ms iteration = 12 status = {}
79532024-12-12T22:39:56.510ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79542024-12-12T22:39:56.510ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79552024-12-12T22:39:56.512ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
79562024-12-12T22:39:56.512ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79572024-12-12T22:39:56.512ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79582024-12-12T22:39:56.521ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
79592024-12-12T22:39:56.521ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3954bd0-158c-4100-b9a4-ccbddf16e828", "content-length": "134", "date": "Thu, 12 Dec 2024 22:39:55 GMT"} })
79602024-12-12T22:39:56.521ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
79612024-12-12T22:39:56.521ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
79622024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
79632024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
79642024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79652024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79662024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79672024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79682024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
79692024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
79702024-12-12T22:39:56.522ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
79712024-12-12T22:39:56.522ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79722024-12-12T22:39:56.522ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79732024-12-12T22:39:56.524ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
79742024-12-12T22:39:56.525ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "7b3b9f57-a574-4fff-8ea4-db37f8cf4390", "content-length": "2", "date": "Thu, 12 Dec 2024 22:39:55 GMT"} })
79752024-12-12T22:39:56.525ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
79762024-12-12T22:39:56.525ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "e16392ac-976f-4465-84e8-dba969b2a751", "content-length": "52", "date": "Thu, 12 Dec 2024 22:39:55 GMT"} })
79772024-12-12T22:39:56.525ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
79782024-12-12T22:39:56.525ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
79792024-12-12T22:39:56.614ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "60958686-b1d1-491a-9573-49dc6c242764", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79802024-12-12T22:39:56.614ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
79812024-12-12T22:39:56.614ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
79822024-12-12T22:39:56.615ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "df984055-71e1-49a1-a8ac-77f89a77a217", "content-length": "682", "date": "Thu, 12 Dec 2024 22:39:56 GMT"} })
79832024-12-12T22:39:56.615ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79842024-12-12T22:39:56.615ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79852024-12-12T22:39:56.618ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79862024-12-12T22:39:56.618ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79872024-12-12T22:39:56.621ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79882024-12-12T22:39:56.622ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79892024-12-12T22:39:56.624ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
79902024-12-12T22:39:56.624ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
79912024-12-12T22:39:56.630ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 525.008522ms iteration = 12 status = {}
79922024-12-12T22:39:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1041 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = cd5e4039-f078-4e40-8e28-e87d4f4b69b2 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
79932024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 35 reason = Timeout
79942024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
79952024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 35 reason = Timeout
79962024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
79972024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
79982024-12-12T22:40:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
79992024-12-12T22:40:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80002024-12-12T22:40:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80012024-12-12T22:40:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80022024-12-12T22:40:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80032024-12-12T22:40:06.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80042024-12-12T22:40:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80052024-12-12T22:40:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80062024-12-12T22:40:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
80072024-12-12T22:40:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80082024-12-12T22:40:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80092024-12-12T22:40:06.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
80102024-12-12T22:40:06.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.32482ms iteration = 35 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
80112024-12-12T22:40:06.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80122024-12-12T22:40:06.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80132024-12-12T22:40:06.159ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 53.9882ms iteration = 35 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80142024-12-12T22:40:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1547 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = cb71a59d-fcde-45bb-92ad-d39aeda5a2d6 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
80152024-12-12T22:40:16.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 36 reason = Timeout
80162024-12-12T22:40:16.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80172024-12-12T22:40:16.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 36 reason = Timeout
80182024-12-12T22:40:16.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80192024-12-12T22:40:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80202024-12-12T22:40:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80212024-12-12T22:40:16.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80222024-12-12T22:40:16.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
80232024-12-12T22:40:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80242024-12-12T22:40:16.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.158313ms iteration = 36 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
80252024-12-12T22:40:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
80262024-12-12T22:40:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80272024-12-12T22:40:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80282024-12-12T22:40:16.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80292024-12-12T22:40:16.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80302024-12-12T22:40:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
80312024-12-12T22:40:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
80322024-12-12T22:40:16.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80332024-12-12T22:40:16.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
80342024-12-12T22:40:16.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
80352024-12-12T22:40:16.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.40474ms iteration = 36 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
80362024-12-12T22:40:17.188ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1166 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = feb7309d-f9e9-4351-89d0-459f411aef6e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
80372024-12-12T22:40:18.447ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:61027
80382024-12-12T22:40:18.447ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61027 req_id = a4d7d40e-3f73-40c5-9a5f-d70cb8c67608 roles = RoleSet { roles: {} } uri = /metrics/producers
80392024-12-12T22:40:18.448ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61027 req_id = a4d7d40e-3f73-40c5-9a5f-d70cb8c67608 resource = Database result = Ok(()) uri = /metrics/producers
80402024-12-12T22:40:18.490ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 4a8c9490-d35a-4221-8585-e4103b325118
80412024-12-12T22:40:18.490ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42511 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:61027 req_id = a4d7d40e-3f73-40c5-9a5f-d70cb8c67608 response_code = 201 uri = /metrics/producers
80422024-12-12T22:40:25.078ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:54717
80432024-12-12T22:40:25.079ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54717 req_id = 758da939-d9bd-464b-bdd5-2019b2d56cd4 roles = RoleSet { roles: {} } uri = /metrics/producers
80442024-12-12T22:40:25.079ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54717 req_id = 758da939-d9bd-464b-bdd5-2019b2d56cd4 resource = Database result = Ok(()) uri = /metrics/producers
80452024-12-12T22:40:25.118ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e7680fb8-0ccd-466c-b928-9ebe5b97f2ca
80462024-12-12T22:40:25.118ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 39964 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:54717 req_id = 758da939-d9bd-464b-bdd5-2019b2d56cd4 response_code = 201 uri = /metrics/producers
80472024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 13 reason = Timeout
80482024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 13 reason = Timeout
80492024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
80502024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 7 reason = Timeout
80512024-12-12T22:40:26.104ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
80522024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 7 reason = Timeout
80532024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 7 reason = Timeout
80542024-12-12T22:40:26.104ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:30:26.104656020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
80552024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 8 reason = Timeout
80562024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
80572024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
80582024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
80592024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 8 reason = Timeout
80602024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 8 reason = Timeout
80612024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 8 reason = Timeout
80622024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
80632024-12-12T22:40:26.104ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
80642024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 14 reason = Timeout
80652024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.35\u{b5}s iteration = 8 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
80662024-12-12T22:40:26.104ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
80672024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 9 reason = Timeout
80682024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
80692024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 37 reason = Timeout
80702024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 4 reason = Timeout
80712024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
80722024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
80732024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 8 reason = Timeout
80742024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
80752024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 8 reason = Timeout
80762024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
80772024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
80782024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
80792024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 13 reason = Timeout
80802024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 13 reason = Timeout
80812024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
80822024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 13 reason = Timeout
80832024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
80842024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 13 reason = Timeout
80852024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
80862024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
80872024-12-12T22:40:26.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
80882024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 37 reason = Timeout
80892024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
80902024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 13 reason = Timeout
80912024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 9 reason = Timeout
80922024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
80932024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 15 reason = Timeout
80942024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
80952024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 13 reason = Timeout
80962024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
80972024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 13 reason = Timeout
80982024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
80992024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
81002024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81012024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81022024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
81032024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81042024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81052024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81062024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81072024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
81082024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81092024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81102024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81112024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81122024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81132024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
81142024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
81152024-12-12T22:40:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3757, tv_nsec: 27228262 } })
81162024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 7 reason = Timeout
81172024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81182024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
81192024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 13 reason = Timeout
81202024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 13 reason = Timeout
81212024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
81222024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
81232024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
81242024-12-12T22:40:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3757, tv_nsec: 27259062 } })
81252024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 7 reason = Timeout
81262024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 13 reason = Timeout
81272024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
81282024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
81292024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81302024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81312024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 13 reason = Timeout
81322024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
81332024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
81342024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
81352024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81362024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81372024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
81382024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
81392024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
81402024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
81412024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
81422024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
81432024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81442024-12-12T22:40:26.105ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81452024-12-12T22:40:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
81462024-12-12T22:40:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.360447ms iteration = 8 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
81472024-12-12T22:40:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
81482024-12-12T22:40:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.445869ms iteration = 8 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
81492024-12-12T22:40:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81502024-12-12T22:40:26.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81512024-12-12T22:40:26.108ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:30:26.104656020 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
81522024-12-12T22:40:26.108ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.720853ms iteration = 7 status = {"expiration":"2024-12-12T22:30:26.104656020Z","pruned":[]}
81532024-12-12T22:40:26.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81542024-12-12T22:40:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.893176ms iteration = 13 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
81552024-12-12T22:40:26.109ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81562024-12-12T22:40:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
81572024-12-12T22:40:26.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
81582024-12-12T22:40:26.110ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81592024-12-12T22:40:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
81602024-12-12T22:40:26.111ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81612024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
81622024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
81632024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
81642024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81652024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
81662024-12-12T22:40:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
81672024-12-12T22:40:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
81682024-12-12T22:40:26.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
81692024-12-12T22:40:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
81702024-12-12T22:40:26.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
81712024-12-12T22:40:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
81722024-12-12T22:40:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
81732024-12-12T22:40:26.116ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
81742024-12-12T22:40:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
81752024-12-12T22:40:26.117ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3757, tv_nsec: 39532783 } })
81762024-12-12T22:40:26.118ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81772024-12-12T22:40:26.118ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
81782024-12-12T22:40:26.118ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
81792024-12-12T22:40:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
81802024-12-12T22:40:26.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81812024-12-12T22:40:26.119ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
81822024-12-12T22:40:26.119ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
81832024-12-12T22:40:26.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
81842024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
81852024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
81862024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
81872024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
81882024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81892024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
81902024-12-12T22:40:26.120ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
81912024-12-12T22:40:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
81922024-12-12T22:40:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
81932024-12-12T22:40:26.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
81942024-12-12T22:40:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
81952024-12-12T22:40:26.123ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
81962024-12-12T22:40:26.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3757, tv_nsec: 47526050 } })
81972024-12-12T22:40:26.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
81982024-12-12T22:40:26.126ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
81992024-12-12T22:40:26.126ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82002024-12-12T22:40:26.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82012024-12-12T22:40:26.126ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 21.347889ms iteration = 7 status = {"errors":[],"found_port_ok":[]}
82022024-12-12T22:40:26.128ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 23.025862ms iteration = 13 status = {"errors":[],"records_set_to_done":[]}
82032024-12-12T22:40:26.129ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82042024-12-12T22:40:26.129ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
82052024-12-12T22:40:26.129ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
82062024-12-12T22:40:26.129ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 24.4428ms iteration = 7 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
82072024-12-12T22:40:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82082024-12-12T22:40:26.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82092024-12-12T22:40:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82102024-12-12T22:40:26.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82112024-12-12T22:40:26.131ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3757, tv_nsec: 53490067 } })
82122024-12-12T22:40:26.132ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
82132024-12-12T22:40:26.133ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82142024-12-12T22:40:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82152024-12-12T22:40:26.133ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82162024-12-12T22:40:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82172024-12-12T22:40:26.135ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
82182024-12-12T22:40:26.135ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82192024-12-12T22:40:26.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82202024-12-12T22:40:26.137ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82212024-12-12T22:40:26.137ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82222024-12-12T22:40:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82232024-12-12T22:40:26.140ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82242024-12-12T22:40:26.140ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
82252024-12-12T22:40:26.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82262024-12-12T22:40:26.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82272024-12-12T22:40:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82282024-12-12T22:40:26.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82292024-12-12T22:40:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82302024-12-12T22:40:26.156ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82312024-12-12T22:40:26.158ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
82322024-12-12T22:40:26.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
82332024-12-12T22:40:26.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
82342024-12-12T22:40:26.159ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
82352024-12-12T22:40:26.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
82362024-12-12T22:40:26.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 60.508489ms iteration = 13 status = {"errors":[],"garbage_collect_requested":[]}
82372024-12-12T22:40:26.166ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82382024-12-12T22:40:26.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82392024-12-12T22:40:26.171ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
82402024-12-12T22:40:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
82412024-12-12T22:40:26.174ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82422024-12-12T22:40:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
82432024-12-12T22:40:26.179ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
82442024-12-12T22:40:26.179ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
82452024-12-12T22:40:26.179ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
82462024-12-12T22:40:26.179ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
82472024-12-12T22:40:26.179ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
82482024-12-12T22:40:26.180ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
82492024-12-12T22:40:26.180ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82502024-12-12T22:40:26.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
82512024-12-12T22:40:26.181ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
82522024-12-12T22:40:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
82532024-12-12T22:40:26.182ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
82542024-12-12T22:40:26.182ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
82552024-12-12T22:40:26.182ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 77.406471ms iteration = 7 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
82562024-12-12T22:40:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
82572024-12-12T22:40:26.182ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
82582024-12-12T22:40:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
82592024-12-12T22:40:26.184ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
82602024-12-12T22:40:26.184ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
82612024-12-12T22:40:26.184ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
82622024-12-12T22:40:26.184ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
82632024-12-12T22:40:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
82642024-12-12T22:40:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
82652024-12-12T22:40:26.189ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
82662024-12-12T22:40:26.189ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
82672024-12-12T22:40:26.189ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
82682024-12-12T22:40:26.189ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
82692024-12-12T22:40:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
82702024-12-12T22:40:26.191ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
82712024-12-12T22:40:26.191ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82722024-12-12T22:40:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
82732024-12-12T22:40:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
82742024-12-12T22:40:26.193ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
82752024-12-12T22:40:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
82762024-12-12T22:40:26.278ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
82772024-12-12T22:40:26.278ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
82782024-12-12T22:40:26.279ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "575c4a6a-2bd3-4cd4-9938-2bcdb5d9c8ea", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:25 GMT"} })
82792024-12-12T22:40:26.279ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
82802024-12-12T22:40:26.280ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
82812024-12-12T22:40:26.311ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
82822024-12-12T22:40:26.311ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
82832024-12-12T22:40:26.311ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "137010a2-9136-44fc-a61d-0d0c3eb8ee11", "content-length": "372", "date": "Thu, 12 Dec 2024 22:40:25 GMT"} })
82842024-12-12T22:40:26.311ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
82852024-12-12T22:40:26.312ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
82862024-12-12T22:40:26.313ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82872024-12-12T22:40:26.313ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82882024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
82892024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
82902024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
82912024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
82922024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
82932024-12-12T22:40:26.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
82942024-12-12T22:40:26.318ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
82952024-12-12T22:40:26.319ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
82962024-12-12T22:40:26.325ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 220.238145ms iteration = 4 status = {"nsuccess":5}
82972024-12-12T22:40:26.325ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 220.701405ms iteration = 13 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
82982024-12-12T22:40:26.325ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
82992024-12-12T22:40:26.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83002024-12-12T22:40:26.326ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83012024-12-12T22:40:26.326ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83022024-12-12T22:40:26.326ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
83032024-12-12T22:40:26.326ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
83042024-12-12T22:40:26.326ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 222.044431ms iteration = 13 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
83052024-12-12T22:40:26.328ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83062024-12-12T22:40:26.328ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83072024-12-12T22:40:26.328ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83082024-12-12T22:40:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83092024-12-12T22:40:26.329ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83102024-12-12T22:40:26.329ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83112024-12-12T22:40:26.333ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
83122024-12-12T22:40:26.333ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 227.813764ms iteration = 13 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
83132024-12-12T22:40:26.344ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
83142024-12-12T22:40:26.344ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 239.941002ms iteration = 37 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
83152024-12-12T22:40:26.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 251.158183ms iteration = 37 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
83162024-12-12T22:40:26.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 251.823136ms iteration = 13 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
83172024-12-12T22:40:26.359ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
83182024-12-12T22:40:26.362ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
83192024-12-12T22:40:26.362ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 257.60799ms iteration = 13 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
83202024-12-12T22:40:26.362ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83212024-12-12T22:40:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83222024-12-12T22:40:26.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83232024-12-12T22:40:26.368ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83242024-12-12T22:40:26.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83252024-12-12T22:40:26.370ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
83262024-12-12T22:40:26.370ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83272024-12-12T22:40:26.370ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
83282024-12-12T22:40:26.370ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
83292024-12-12T22:40:26.372ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
83302024-12-12T22:40:26.372ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
83312024-12-12T22:40:26.372ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83322024-12-12T22:40:26.372ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83332024-12-12T22:40:26.373ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83342024-12-12T22:40:26.373ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83352024-12-12T22:40:26.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83362024-12-12T22:40:26.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83372024-12-12T22:40:26.375ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
83382024-12-12T22:40:26.375ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
83392024-12-12T22:40:26.375ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83402024-12-12T22:40:26.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83412024-12-12T22:40:26.376ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83422024-12-12T22:40:26.376ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 271.272188ms iteration = 13 status = 0
83432024-12-12T22:40:26.377ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83442024-12-12T22:40:26.378ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
83452024-12-12T22:40:26.378ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
83462024-12-12T22:40:26.378ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
83472024-12-12T22:40:26.379ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
83482024-12-12T22:40:26.379ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
83492024-12-12T22:40:26.379ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
83502024-12-12T22:40:26.381ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
83512024-12-12T22:40:26.381ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
83522024-12-12T22:40:26.381ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
83532024-12-12T22:40:26.384ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
83542024-12-12T22:40:26.384ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
83552024-12-12T22:40:26.384ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
83562024-12-12T22:40:26.384ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 279.51375ms iteration = 8 status = {"generation":2}
83572024-12-12T22:40:26.385ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
83582024-12-12T22:40:26.385ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
83592024-12-12T22:40:26.385ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
83602024-12-12T22:40:26.385ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 280.324395ms iteration = 8 status = {"generation":1}
83612024-12-12T22:40:26.391ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
83622024-12-12T22:40:26.391ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
83632024-12-12T22:40:26.400ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
83642024-12-12T22:40:26.401ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
83652024-12-12T22:40:26.401ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 297.200987ms iteration = 7 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
83662024-12-12T22:40:26.402ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
83672024-12-12T22:40:26.402ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83682024-12-12T22:40:26.402ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "59c4ea70-6e85-4006-a9cc-e3351fec9936", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
83692024-12-12T22:40:26.402ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83702024-12-12T22:40:26.402ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
83712024-12-12T22:40:26.402ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
83722024-12-12T22:40:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
83732024-12-12T22:40:26.405ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
83742024-12-12T22:40:26.420ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
83752024-12-12T22:40:26.420ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
83762024-12-12T22:40:26.420ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "94e99d28-8e40-452a-836d-6109f71b2186", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
83772024-12-12T22:40:26.420ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
83782024-12-12T22:40:26.423ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
83792024-12-12T22:40:26.432ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 327.299468ms iteration = 13 status = {}
83802024-12-12T22:40:26.444ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
83812024-12-12T22:40:26.444ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 339.936696ms iteration = 8 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
83822024-12-12T22:40:26.446ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 341.288194ms iteration = 15 status = {"physical_disks_added":0}
83832024-12-12T22:40:26.486ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "f153bbe6-8596-4691-bb38-865639a9149d", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
83842024-12-12T22:40:26.486ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83852024-12-12T22:40:26.486ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83862024-12-12T22:40:26.489ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83872024-12-12T22:40:26.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83882024-12-12T22:40:26.492ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
83892024-12-12T22:40:26.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
83902024-12-12T22:40:26.496ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
83912024-12-12T22:40:26.496ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
83922024-12-12T22:40:26.497ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "e19f3dab-8c35-42b5-8bfa-3ea03a1e298d", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
83932024-12-12T22:40:26.497ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
83942024-12-12T22:40:26.499ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 394.747723ms iteration = 14 status = {}
83952024-12-12T22:40:26.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
83962024-12-12T22:40:26.522ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "61f64bc4-80a4-473b-833a-095ed0be2735", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83972024-12-12T22:40:26.522ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83982024-12-12T22:40:26.523ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "59f804ca-1dfe-4358-93b7-76626cbc1907", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
83992024-12-12T22:40:26.523ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84002024-12-12T22:40:26.524ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
84012024-12-12T22:40:26.524ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 420.003929ms iteration = 9 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
84022024-12-12T22:40:26.534ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
84032024-12-12T22:40:26.534ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1f44a520-db85-41a3-bacf-132ad6be4cab", "content-length": "1", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84042024-12-12T22:40:26.536ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
84052024-12-12T22:40:26.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
84062024-12-12T22:40:26.599ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
84072024-12-12T22:40:26.599ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "a7a29bac-dcda-4684-9aaa-a38523b50d9e", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84082024-12-12T22:40:26.599ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84092024-12-12T22:40:26.601ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "a44951f8-5c42-4c39-ad98-dd3cdf8dc7ce", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84102024-12-12T22:40:26.601ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84112024-12-12T22:40:26.603ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "1bd37ff4-4ab6-4267-ae7b-fd93bea1233b", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84122024-12-12T22:40:26.603ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84132024-12-12T22:40:26.605ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
84142024-12-12T22:40:26.605ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 500.612242ms iteration = 9 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
84152024-12-12T22:40:26.642ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
84162024-12-12T22:40:26.643ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "25bdb5cb-9bf8-4404-aa00-623e2be9dcd6", "content-length": "691", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84172024-12-12T22:40:26.643ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
84182024-12-12T22:40:26.643ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
84192024-12-12T22:40:26.643ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
84202024-12-12T22:40:26.644ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 539.736551ms iteration = 13 status = {}
84212024-12-12T22:40:26.644ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 539.883273ms iteration = 13 status = null
84222024-12-12T22:40:26.695ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84232024-12-12T22:40:26.696ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84242024-12-12T22:40:26.698ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
84252024-12-12T22:40:26.698ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84262024-12-12T22:40:26.698ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84272024-12-12T22:40:26.707ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
84282024-12-12T22:40:26.708ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "04b86d0b-481e-4560-b5d9-7e635a6e0da5", "content-length": "134", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84292024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
84302024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
84312024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
84322024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
84332024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84342024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84352024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84362024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84372024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
84382024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
84392024-12-12T22:40:26.708ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
84402024-12-12T22:40:26.708ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84412024-12-12T22:40:26.709ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84422024-12-12T22:40:26.710ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
84432024-12-12T22:40:26.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "59db62eb-615b-449b-bda6-b3fa1569c1d9", "content-length": "2", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84442024-12-12T22:40:26.711ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
84452024-12-12T22:40:26.711ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "371ce868-123b-4478-aafe-f9e51c6c39df", "content-length": "52", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84462024-12-12T22:40:26.711ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
84472024-12-12T22:40:26.711ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
84482024-12-12T22:40:26.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "80471fde-a590-42e5-a0a0-24b5d5187656", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84492024-12-12T22:40:26.797ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
84502024-12-12T22:40:26.797ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
84512024-12-12T22:40:26.800ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e65c8e8-084d-426d-8de9-770d3cd10741", "content-length": "682", "date": "Thu, 12 Dec 2024 22:40:26 GMT"} })
84522024-12-12T22:40:26.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84532024-12-12T22:40:26.801ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84542024-12-12T22:40:26.804ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84552024-12-12T22:40:26.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84562024-12-12T22:40:26.808ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84572024-12-12T22:40:26.808ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84582024-12-12T22:40:26.810ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
84592024-12-12T22:40:26.810ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
84602024-12-12T22:40:26.817ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 712.80184ms iteration = 13 status = {}
84612024-12-12T22:40:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1075 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = c9499ebb-ce4a-447c-82b5-05d5f08eca76 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
84622024-12-12T22:40:33.096ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:39063
84632024-12-12T22:40:33.096ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39063 req_id = 5ecfb590-d75e-4968-9ce3-ddb3fb79db0a roles = RoleSet { roles: {} } uri = /metrics/producers
84642024-12-12T22:40:33.096ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39063 req_id = 5ecfb590-d75e-4968-9ce3-ddb3fb79db0a resource = Database result = Ok(()) uri = /metrics/producers
84652024-12-12T22:40:33.134ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 9be55e3b-79ee-4930-a117-2473cfadb163
84662024-12-12T22:40:33.134ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38333 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:39063 req_id = 5ecfb590-d75e-4968-9ce3-ddb3fb79db0a response_code = 201 uri = /metrics/producers
84672024-12-12T22:40:35.263ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:47153
84682024-12-12T22:40:35.264ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47153 req_id = a77e8b34-33cb-46a9-8b83-eed76b7d46c2 roles = RoleSet { roles: {} } uri = /metrics/producers
84692024-12-12T22:40:35.264ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47153 req_id = a77e8b34-33cb-46a9-8b83-eed76b7d46c2 resource = Database result = Ok(()) uri = /metrics/producers
84702024-12-12T22:40:35.304ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e736935f-49fd-4441-90a4-7226a6f1fe8e
84712024-12-12T22:40:35.304ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40947 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:47153 req_id = a77e8b34-33cb-46a9-8b83-eed76b7d46c2 response_code = 201 uri = /metrics/producers
84722024-12-12T22:40:35.948ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:54377
84732024-12-12T22:40:35.948ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54377 req_id = bff23c34-c734-455b-8cbf-bebaf71ad83e roles = RoleSet { roles: {} } uri = /metrics/producers
84742024-12-12T22:40:35.949ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54377 req_id = bff23c34-c734-455b-8cbf-bebaf71ad83e resource = Database result = Ok(()) uri = /metrics/producers
84752024-12-12T22:40:35.989ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 35574f6f-1e6c-4add-9efb-f5d5c83e2007
84762024-12-12T22:40:35.989ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 40375 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:54377 req_id = bff23c34-c734-455b-8cbf-bebaf71ad83e response_code = 201 uri = /metrics/producers
84772024-12-12T22:40:36.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 38 reason = Timeout
84782024-12-12T22:40:36.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 38 reason = Timeout
84792024-12-12T22:40:36.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84802024-12-12T22:40:36.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84812024-12-12T22:40:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84822024-12-12T22:40:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84832024-12-12T22:40:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84842024-12-12T22:40:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
84852024-12-12T22:40:36.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84862024-12-12T22:40:36.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84872024-12-12T22:40:36.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84882024-12-12T22:40:36.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84892024-12-12T22:40:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
84902024-12-12T22:40:36.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
84912024-12-12T22:40:36.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
84922024-12-12T22:40:36.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
84932024-12-12T22:40:36.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
84942024-12-12T22:40:36.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.630425ms iteration = 38 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
84952024-12-12T22:40:36.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
84962024-12-12T22:40:36.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
84972024-12-12T22:40:36.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.482048ms iteration = 38 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
84982024-12-12T22:40:37.190ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1250 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 016105a9-cfb0-412f-b1d1-2dc2b5a23e08 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
84992024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 39 reason = Timeout
85002024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85012024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 39 reason = Timeout
85022024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85032024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85042024-12-12T22:40:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85052024-12-12T22:40:46.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85062024-12-12T22:40:46.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85072024-12-12T22:40:46.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85082024-12-12T22:40:46.135ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 30.456929ms iteration = 39 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
85092024-12-12T22:40:46.137ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
85102024-12-12T22:40:46.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85112024-12-12T22:40:46.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85122024-12-12T22:40:46.138ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85132024-12-12T22:40:46.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85142024-12-12T22:40:46.140ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85152024-12-12T22:40:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
85162024-12-12T22:40:46.143ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85172024-12-12T22:40:46.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85182024-12-12T22:40:46.154ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
85192024-12-12T22:40:46.154ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 49.419871ms iteration = 39 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
85202024-12-12T22:40:47.179ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::d]:42653
85212024-12-12T22:40:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 00254cff-f6a5-4c5a-8dc8-7d0ed41c466d roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
85222024-12-12T22:40:47.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 00254cff-f6a5-4c5a-8dc8-7d0ed41c466d resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
85232024-12-12T22:40:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3034 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 00254cff-f6a5-4c5a-8dc8-7d0ed41c466d response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
85242024-12-12T22:40:47.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = df23df87-eb46-409b-83c6-b5c8d8acbdbb roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
85252024-12-12T22:40:47.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = df23df87-eb46-409b-83c6-b5c8d8acbdbb resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
85262024-12-12T22:40:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2065 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = df23df87-eb46-409b-83c6-b5c8d8acbdbb response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
85272024-12-12T22:40:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1591 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 8d685a13-c80c-4381-af9e-0b8e7c73d695 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
85282024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 40 reason = Timeout
85292024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
85302024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 14 reason = Timeout
85312024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 14 reason = Timeout
85322024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
85332024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
85342024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 14 reason = Timeout
85352024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
85362024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 14 reason = Timeout
85372024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
85382024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 40 reason = Timeout
85392024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 14 reason = Timeout
85402024-12-12T22:40:56.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85412024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 15 reason = Timeout
85422024-12-12T22:40:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
85432024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
85442024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
85452024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 14 reason = Timeout
85462024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 16 reason = Timeout
85472024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 14 reason = Timeout
85482024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85492024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 14 reason = Timeout
85502024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
85512024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 14 reason = Timeout
85522024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
85532024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
85542024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85552024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
85562024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85572024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
85582024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
85592024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
85602024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
85612024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
85622024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
85632024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85642024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85652024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
85662024-12-12T22:40:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
85672024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 14 reason = Timeout
85682024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 14 reason = Timeout
85692024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
85702024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
85712024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 14 reason = Timeout
85722024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
85732024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 14 reason = Timeout
85742024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
85752024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
85762024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
85772024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
85782024-12-12T22:40:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
85792024-12-12T22:40:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85802024-12-12T22:40:56.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.964318ms iteration = 14 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
85812024-12-12T22:40:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3787, tv_nsec: 31166091 } })
85822024-12-12T22:40:56.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
85832024-12-12T22:40:56.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
85842024-12-12T22:40:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
85852024-12-12T22:40:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
85862024-12-12T22:40:56.112ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
85872024-12-12T22:40:56.113ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
85882024-12-12T22:40:56.113ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
85892024-12-12T22:40:56.113ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
85902024-12-12T22:40:56.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
85912024-12-12T22:40:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
85922024-12-12T22:40:56.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85932024-12-12T22:40:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85942024-12-12T22:40:56.115ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3787, tv_nsec: 37655778 } })
85952024-12-12T22:40:56.116ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
85962024-12-12T22:40:56.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
85972024-12-12T22:40:56.121ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3787, tv_nsec: 42879471 } })
85982024-12-12T22:40:56.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
85992024-12-12T22:40:56.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
86002024-12-12T22:40:56.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86012024-12-12T22:40:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
86022024-12-12T22:40:56.127ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
86032024-12-12T22:40:56.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
86042024-12-12T22:40:56.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
86052024-12-12T22:40:56.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
86062024-12-12T22:40:56.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86072024-12-12T22:40:56.149ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86082024-12-12T22:40:56.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
86092024-12-12T22:40:56.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86102024-12-12T22:40:56.150ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86112024-12-12T22:40:56.152ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
86122024-12-12T22:40:56.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
86132024-12-12T22:40:56.152ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86142024-12-12T22:40:56.153ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86152024-12-12T22:40:56.153ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86162024-12-12T22:40:56.153ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86172024-12-12T22:40:56.154ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86182024-12-12T22:40:56.154ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
86192024-12-12T22:40:56.154ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
86202024-12-12T22:40:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
86212024-12-12T22:40:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
86222024-12-12T22:40:56.155ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86232024-12-12T22:40:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86242024-12-12T22:40:56.156ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 49.999693ms iteration = 14 status = {"errors":[],"garbage_collect_requested":[]}
86252024-12-12T22:40:56.157ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86262024-12-12T22:40:56.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86272024-12-12T22:40:56.158ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86282024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86292024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
86302024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86312024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86322024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86332024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86342024-12-12T22:40:56.160ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86352024-12-12T22:40:56.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86362024-12-12T22:40:56.161ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86372024-12-12T22:40:56.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 55.830356ms iteration = 14 status = {"errors":[],"records_set_to_done":[]}
86382024-12-12T22:40:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
86392024-12-12T22:40:56.163ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
86402024-12-12T22:40:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
86412024-12-12T22:40:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
86422024-12-12T22:40:56.165ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
86432024-12-12T22:40:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
86442024-12-12T22:40:56.169ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
86452024-12-12T22:40:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
86462024-12-12T22:40:56.173ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
86472024-12-12T22:40:56.173ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 66.727081ms iteration = 14 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
86482024-12-12T22:40:56.183ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
86492024-12-12T22:40:56.183ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 78.892829ms iteration = 40 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
86502024-12-12T22:40:56.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 82.685774ms iteration = 40 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
86512024-12-12T22:40:56.190ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86522024-12-12T22:40:56.190ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86532024-12-12T22:40:56.190ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "44540d55-6421-49cb-8528-eb1cf160d87d", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
86542024-12-12T22:40:56.190ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86552024-12-12T22:40:56.192ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86562024-12-12T22:40:56.194ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 89.675001ms iteration = 14 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
86572024-12-12T22:40:56.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86582024-12-12T22:40:56.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86592024-12-12T22:40:56.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86602024-12-12T22:40:56.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86612024-12-12T22:40:56.198ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
86622024-12-12T22:40:56.201ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
86632024-12-12T22:40:56.201ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
86642024-12-12T22:40:56.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 96.160988ms iteration = 14 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
86652024-12-12T22:40:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
86662024-12-12T22:40:56.201ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
86672024-12-12T22:40:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
86682024-12-12T22:40:56.202ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
86692024-12-12T22:40:56.202ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86702024-12-12T22:40:56.202ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "a36e42a6-3b75-42d0-998b-404407778f58", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
86712024-12-12T22:40:56.202ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86722024-12-12T22:40:56.203ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 98.760129ms iteration = 14 status = 0
86732024-12-12T22:40:56.204ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 98.120687ms iteration = 14 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
86742024-12-12T22:40:56.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
86752024-12-12T22:40:56.205ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
86762024-12-12T22:40:56.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
86772024-12-12T22:40:56.207ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 101.050305ms iteration = 14 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
86782024-12-12T22:40:56.218ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
86792024-12-12T22:40:56.218ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
86802024-12-12T22:40:56.219ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "67cdde2f-9dfe-4bda-b729-41dc5e7d1b83", "content-length": "26", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
86812024-12-12T22:40:56.219ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
86822024-12-12T22:40:56.221ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
86832024-12-12T22:40:56.232ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
86842024-12-12T22:40:56.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
86852024-12-12T22:40:56.234ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 129.414282ms iteration = 16 status = {"physical_disks_added":0}
86862024-12-12T22:40:56.273ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
86872024-12-12T22:40:56.274ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "19eedc57-0891-4b1b-a28f-6920515d88d9", "content-length": "1", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
86882024-12-12T22:40:56.275ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
86892024-12-12T22:40:56.276ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
86902024-12-12T22:40:56.289ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 184.410781ms iteration = 14 status = {}
86912024-12-12T22:40:56.301ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
86922024-12-12T22:40:56.301ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
86932024-12-12T22:40:56.301ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "86252ebc-952c-44e4-8b12-222e82e76a19", "content-length": "372", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
86942024-12-12T22:40:56.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
86952024-12-12T22:40:56.302ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
86962024-12-12T22:40:56.303ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.732843ms iteration = 14 status = null
86972024-12-12T22:40:56.344ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
86982024-12-12T22:40:56.344ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
86992024-12-12T22:40:56.345ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "245d9a6d-14f2-47e4-b77e-7727d21bee2a", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87002024-12-12T22:40:56.345ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87012024-12-12T22:40:56.345ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87022024-12-12T22:40:56.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87032024-12-12T22:40:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87042024-12-12T22:40:56.350ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
87052024-12-12T22:40:56.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
87062024-12-12T22:40:56.353ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
87072024-12-12T22:40:56.353ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
87082024-12-12T22:40:56.354ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "3e6331aa-26db-412b-9926-2b7d0f648273", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87092024-12-12T22:40:56.356ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 251.315516ms iteration = 15 status = {}
87102024-12-12T22:40:56.357ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87112024-12-12T22:40:56.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87122024-12-12T22:40:56.360ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
87132024-12-12T22:40:56.360ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87142024-12-12T22:40:56.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87152024-12-12T22:40:56.373ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
87162024-12-12T22:40:56.374ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "b2cf8ccd-00a8-466a-bcbe-d49c6ccf1a68", "content-length": "134", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87172024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
87182024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
87192024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
87202024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
87212024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87222024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87232024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87242024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87252024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
87262024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
87272024-12-12T22:40:56.374ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
87282024-12-12T22:40:56.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87292024-12-12T22:40:56.375ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87302024-12-12T22:40:56.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
87312024-12-12T22:40:56.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "bbd0e0de-d30f-4bea-aacb-7d9e1710c3ac", "content-length": "2", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87322024-12-12T22:40:56.377ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
87332024-12-12T22:40:56.377ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "3e806ae2-4a08-4006-90db-8abe5ab062fa", "content-length": "52", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87342024-12-12T22:40:56.377ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
87352024-12-12T22:40:56.377ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
87362024-12-12T22:40:56.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87372024-12-12T22:40:56.394ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87382024-12-12T22:40:56.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87392024-12-12T22:40:56.398ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87402024-12-12T22:40:56.398ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87412024-12-12T22:40:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87422024-12-12T22:40:56.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87432024-12-12T22:40:56.401ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
87442024-12-12T22:40:56.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
87452024-12-12T22:40:56.401ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
87462024-12-12T22:40:56.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4e34edb0-d338-4439-b1e6-b30413521678", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87472024-12-12T22:40:56.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
87482024-12-12T22:40:56.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
87492024-12-12T22:40:56.485ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "378511ff-9fe1-4d4a-a69c-a2b64c802393", "content-length": "682", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87502024-12-12T22:40:56.485ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87512024-12-12T22:40:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87522024-12-12T22:40:56.489ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87532024-12-12T22:40:56.489ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87542024-12-12T22:40:56.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87552024-12-12T22:40:56.493ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87562024-12-12T22:40:56.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
87572024-12-12T22:40:56.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
87582024-12-12T22:40:56.497ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
87592024-12-12T22:40:56.498ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "d860c212-b086-4bd9-af12-a1e5f7658f80", "content-length": "691", "date": "Thu, 12 Dec 2024 22:40:55 GMT"} })
87602024-12-12T22:40:56.498ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
87612024-12-12T22:40:56.498ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
87622024-12-12T22:40:56.498ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
87632024-12-12T22:40:56.500ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 395.733792ms iteration = 14 status = {}
87642024-12-12T22:40:56.502ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 398.002457ms iteration = 14 status = {}
87652024-12-12T22:40:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1074 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 45714043-cb49-4964-a12f-7f5a9044f6ce response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
87662024-12-12T22:41:02.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83d7db2e-c9d8-41ab-912a-e3e34ac34030 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
87672024-12-12T22:41:02.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83d7db2e-c9d8-41ab-912a-e3e34ac34030 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
87682024-12-12T22:41:02.183ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3619 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83d7db2e-c9d8-41ab-912a-e3e34ac34030 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
87692024-12-12T22:41:02.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 54b364a2-99c0-4c77-b172-18b97e399d74 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
87702024-12-12T22:41:02.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 54b364a2-99c0-4c77-b172-18b97e399d74 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
87712024-12-12T22:41:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2456 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 54b364a2-99c0-4c77-b172-18b97e399d74 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
87722024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 41 reason = Timeout
87732024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87742024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 41 reason = Timeout
87752024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87762024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87772024-12-12T22:41:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87782024-12-12T22:41:06.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87792024-12-12T22:41:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87802024-12-12T22:41:06.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87812024-12-12T22:41:06.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.607871ms iteration = 41 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
87822024-12-12T22:41:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
87832024-12-12T22:41:06.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87842024-12-12T22:41:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87852024-12-12T22:41:06.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87862024-12-12T22:41:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87872024-12-12T22:41:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
87882024-12-12T22:41:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
87892024-12-12T22:41:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87902024-12-12T22:41:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
87912024-12-12T22:41:06.128ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
87922024-12-12T22:41:06.128ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 23.134434ms iteration = 41 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
87932024-12-12T22:41:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1133 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 26ff07a5-e16b-416f-9d25-c20247481884 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
87942024-12-12T22:41:16.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 42 reason = Timeout
87952024-12-12T22:41:16.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
87962024-12-12T22:41:16.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 42 reason = Timeout
87972024-12-12T22:41:16.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
87982024-12-12T22:41:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
87992024-12-12T22:41:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88002024-12-12T22:41:16.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88012024-12-12T22:41:16.110ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88022024-12-12T22:41:16.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88032024-12-12T22:41:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
88042024-12-12T22:41:16.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88052024-12-12T22:41:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88062024-12-12T22:41:16.112ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 7.504377ms iteration = 42 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
88072024-12-12T22:41:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88082024-12-12T22:41:16.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88092024-12-12T22:41:16.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
88102024-12-12T22:41:16.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
88112024-12-12T22:41:16.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88122024-12-12T22:41:16.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88132024-12-12T22:41:16.129ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
88142024-12-12T22:41:16.129ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 24.888169ms iteration = 42 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
88152024-12-12T22:41:17.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1222 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 62684dc1-cbee-4870-8301-ae39be72a2e8 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
88162024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 15 reason = Timeout
88172024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 15 reason = Timeout
88182024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
88192024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 8 reason = Timeout
88202024-12-12T22:41:26.104ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
88212024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 8 reason = Timeout
88222024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 8 reason = Timeout
88232024-12-12T22:41:26.104ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:31:26.104701186 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
88242024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
88252024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
88262024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
88272024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 9 reason = Timeout
88282024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
88292024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 16 reason = Timeout
88302024-12-12T22:41:26.104ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
88312024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 9 reason = Timeout
88322024-12-12T22:41:26.104ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
88332024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
88342024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 9 reason = Timeout
88352024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.08\u{b5}s iteration = 9 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
88362024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
88372024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
88382024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 15 reason = Timeout
88392024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 9 reason = Timeout
88402024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
88412024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 43 reason = Timeout
88422024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 9 reason = Timeout
88432024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
88442024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
88452024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
88462024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 10 reason = Timeout
88472024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 10 reason = Timeout
88482024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 9 reason = Timeout
88492024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 17 reason = Timeout
88502024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 15 reason = Timeout
88512024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
88522024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 15 reason = Timeout
88532024-12-12T22:41:26.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
88542024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 15 reason = Timeout
88552024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
88562024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
88572024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
88582024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 15 reason = Timeout
88592024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
88602024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 15 reason = Timeout
88612024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
88622024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 43 reason = Timeout
88632024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
88642024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 15 reason = Timeout
88652024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
88662024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
88672024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
88682024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
88692024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
88702024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
88712024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
88722024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
88732024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
88742024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
88752024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
88762024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 8 reason = Timeout
88772024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 15 reason = Timeout
88782024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
88792024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
88802024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
88812024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 15 reason = Timeout
88822024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
88832024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
88842024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
88852024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
88862024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 8 reason = Timeout
88872024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 15 reason = Timeout
88882024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 15 reason = Timeout
88892024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
88902024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
88912024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
88922024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
88932024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
88942024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
88952024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
88962024-12-12T22:41:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3817, tv_nsec: 27359599 } })
88972024-12-12T22:41:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3817, tv_nsec: 27378850 } })
88982024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
88992024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
89002024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
89012024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89022024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
89032024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
89042024-12-12T22:41:26.105ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
89052024-12-12T22:41:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.194923ms iteration = 9 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
89062024-12-12T22:41:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
89072024-12-12T22:41:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.283065ms iteration = 9 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
89082024-12-12T22:41:26.107ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:31:26.104701186 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
89092024-12-12T22:41:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 3.124591ms iteration = 8 status = {"expiration":"2024-12-12T22:31:26.104701186Z","pruned":[]}
89102024-12-12T22:41:26.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89112024-12-12T22:41:26.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.168392ms iteration = 15 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
89122024-12-12T22:41:26.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89132024-12-12T22:41:26.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89142024-12-12T22:41:26.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89152024-12-12T22:41:26.110ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89162024-12-12T22:41:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
89172024-12-12T22:41:26.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
89182024-12-12T22:41:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
89192024-12-12T22:41:26.112ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
89202024-12-12T22:41:26.112ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
89212024-12-12T22:41:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
89222024-12-12T22:41:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
89232024-12-12T22:41:26.113ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
89242024-12-12T22:41:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
89252024-12-12T22:41:26.115ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89262024-12-12T22:41:26.116ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89272024-12-12T22:41:26.116ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
89282024-12-12T22:41:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
89292024-12-12T22:41:26.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
89302024-12-12T22:41:26.118ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89312024-12-12T22:41:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89322024-12-12T22:41:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
89332024-12-12T22:41:26.120ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89342024-12-12T22:41:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89352024-12-12T22:41:26.122ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89362024-12-12T22:41:26.123ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
89372024-12-12T22:41:26.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
89382024-12-12T22:41:26.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89392024-12-12T22:41:26.124ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89402024-12-12T22:41:26.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3817, tv_nsec: 46382593 } })
89412024-12-12T22:41:26.124ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3817, tv_nsec: 46480145 } })
89422024-12-12T22:41:26.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89432024-12-12T22:41:26.124ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
89442024-12-12T22:41:26.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
89452024-12-12T22:41:26.127ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 21.833539ms iteration = 15 status = {"errors":[],"garbage_collect_requested":[]}
89462024-12-12T22:41:26.129ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 23.814857ms iteration = 8 status = {"errors":[],"found_port_ok":[]}
89472024-12-12T22:41:26.130ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
89482024-12-12T22:41:26.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89492024-12-12T22:41:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
89502024-12-12T22:41:26.131ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3817, tv_nsec: 53450422 } })
89512024-12-12T22:41:26.131ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
89522024-12-12T22:41:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
89532024-12-12T22:41:26.141ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 36.226191ms iteration = 43 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
89542024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89552024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
89562024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89572024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89582024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89592024-12-12T22:41:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
89602024-12-12T22:41:26.144ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89612024-12-12T22:41:26.144ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89622024-12-12T22:41:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
89632024-12-12T22:41:26.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
89642024-12-12T22:41:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
89652024-12-12T22:41:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
89662024-12-12T22:41:26.148ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
89672024-12-12T22:41:26.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
89682024-12-12T22:41:26.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89692024-12-12T22:41:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
89702024-12-12T22:41:26.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89712024-12-12T22:41:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89722024-12-12T22:41:26.171ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89732024-12-12T22:41:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
89742024-12-12T22:41:26.174ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
89752024-12-12T22:41:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
89762024-12-12T22:41:26.175ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
89772024-12-12T22:41:26.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
89782024-12-12T22:41:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
89792024-12-12T22:41:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
89802024-12-12T22:41:26.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 71.969573ms iteration = 15 status = {"errors":[],"records_set_to_done":[]}
89812024-12-12T22:41:26.177ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
89822024-12-12T22:41:26.177ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
89832024-12-12T22:41:26.177ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
89842024-12-12T22:41:26.177ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
89852024-12-12T22:41:26.177ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89862024-12-12T22:41:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
89872024-12-12T22:41:26.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
89882024-12-12T22:41:26.179ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
89892024-12-12T22:41:26.179ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
89902024-12-12T22:41:26.179ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 73.748238ms iteration = 8 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
89912024-12-12T22:41:26.179ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89922024-12-12T22:41:26.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
89932024-12-12T22:41:26.180ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
89942024-12-12T22:41:26.180ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
89952024-12-12T22:41:26.180ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
89962024-12-12T22:41:26.180ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
89972024-12-12T22:41:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
89982024-12-12T22:41:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
89992024-12-12T22:41:26.181ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
90002024-12-12T22:41:26.181ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
90012024-12-12T22:41:26.182ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90022024-12-12T22:41:26.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90032024-12-12T22:41:26.183ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
90042024-12-12T22:41:26.183ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
90052024-12-12T22:41:26.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
90062024-12-12T22:41:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90072024-12-12T22:41:26.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
90082024-12-12T22:41:26.185ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90092024-12-12T22:41:26.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
90102024-12-12T22:41:26.186ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
90112024-12-12T22:41:26.186ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
90122024-12-12T22:41:26.186ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 81.829087ms iteration = 8 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
90132024-12-12T22:41:26.187ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90142024-12-12T22:41:26.187ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90152024-12-12T22:41:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90162024-12-12T22:41:26.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90172024-12-12T22:41:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90182024-12-12T22:41:26.194ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90192024-12-12T22:41:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90202024-12-12T22:41:26.194ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90212024-12-12T22:41:26.196ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90222024-12-12T22:41:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
90232024-12-12T22:41:26.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
90242024-12-12T22:41:26.198ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
90252024-12-12T22:41:26.199ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
90262024-12-12T22:41:26.199ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
90272024-12-12T22:41:26.199ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
90282024-12-12T22:41:26.200ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
90292024-12-12T22:41:26.200ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 95.568687ms iteration = 43 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
90302024-12-12T22:41:26.200ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
90312024-12-12T22:41:26.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
90322024-12-12T22:41:26.202ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.333751ms iteration = 15 status = 0
90332024-12-12T22:41:26.220ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 115.636511ms iteration = 15 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
90342024-12-12T22:41:26.223ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 118.428096ms iteration = 15 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
90352024-12-12T22:41:26.225ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
90362024-12-12T22:41:26.225ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 120.945346ms iteration = 15 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
90372024-12-12T22:41:26.227ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
90382024-12-12T22:41:26.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
90392024-12-12T22:41:26.229ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 123.550467ms iteration = 15 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
90402024-12-12T22:41:26.232ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
90412024-12-12T22:41:26.232ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
90422024-12-12T22:41:26.232ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
90432024-12-12T22:41:26.232ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90442024-12-12T22:41:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90452024-12-12T22:41:26.234ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90462024-12-12T22:41:26.236ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90472024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
90482024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
90492024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
90502024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
90512024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90522024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
90532024-12-12T22:41:26.236ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90542024-12-12T22:41:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90552024-12-12T22:41:26.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90562024-12-12T22:41:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90572024-12-12T22:41:26.238ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
90582024-12-12T22:41:26.238ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
90592024-12-12T22:41:26.238ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.707017ms iteration = 15 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
90602024-12-12T22:41:26.239ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90612024-12-12T22:41:26.241ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
90622024-12-12T22:41:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
90632024-12-12T22:41:26.242ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
90642024-12-12T22:41:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
90652024-12-12T22:41:26.244ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
90662024-12-12T22:41:26.244ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
90672024-12-12T22:41:26.244ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
90682024-12-12T22:41:26.244ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 139.850097ms iteration = 9 status = {"generation":1}
90692024-12-12T22:41:26.253ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
90702024-12-12T22:41:26.253ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 149.213311ms iteration = 9 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
90712024-12-12T22:41:26.257ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
90722024-12-12T22:41:26.257ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90732024-12-12T22:41:26.258ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "56da59d3-a0be-467c-84a6-d5710f7dcd81", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
90742024-12-12T22:41:26.258ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90752024-12-12T22:41:26.258ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
90762024-12-12T22:41:26.261ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
90772024-12-12T22:41:26.264ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
90782024-12-12T22:41:26.264ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
90792024-12-12T22:41:26.265ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d93f1852-51ff-427b-9054-a6b066be011c", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
90802024-12-12T22:41:26.265ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
90812024-12-12T22:41:26.266ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
90822024-12-12T22:41:26.270ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90832024-12-12T22:41:26.270ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90842024-12-12T22:41:26.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90852024-12-12T22:41:26.275ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90862024-12-12T22:41:26.275ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90872024-12-12T22:41:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90882024-12-12T22:41:26.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90892024-12-12T22:41:26.278ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
90902024-12-12T22:41:26.278ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
90912024-12-12T22:41:26.278ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
90922024-12-12T22:41:26.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
90932024-12-12T22:41:26.279ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
90942024-12-12T22:41:26.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
90952024-12-12T22:41:26.279ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
90962024-12-12T22:41:26.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
90972024-12-12T22:41:26.281ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 176.213311ms iteration = 17 status = {"physical_disks_added":0}
90982024-12-12T22:41:26.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
90992024-12-12T22:41:26.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
91002024-12-12T22:41:26.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
91012024-12-12T22:41:26.287ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
91022024-12-12T22:41:26.287ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
91032024-12-12T22:41:26.287ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
91042024-12-12T22:41:26.287ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 182.612547ms iteration = 9 status = {"generation":2}
91052024-12-12T22:41:26.306ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
91062024-12-12T22:41:26.306ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
91072024-12-12T22:41:26.306ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "170fad37-1a23-4799-b9a8-e0d52f3e1216", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91082024-12-12T22:41:26.306ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
91092024-12-12T22:41:26.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
91102024-12-12T22:41:26.323ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
91112024-12-12T22:41:26.323ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 218.765986ms iteration = 8 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
91122024-12-12T22:41:26.439ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
91132024-12-12T22:41:26.439ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "0711d8a4-83c8-464f-86ae-ee261f7e72ca", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91142024-12-12T22:41:26.439ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91152024-12-12T22:41:26.441ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "b57c06eb-22d2-44c5-8efd-78a2849fcb14", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91162024-12-12T22:41:26.441ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91172024-12-12T22:41:26.443ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
91182024-12-12T22:41:26.443ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 338.381926ms iteration = 10 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
91192024-12-12T22:41:26.460ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
91202024-12-12T22:41:26.460ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "6591ecb6-75c1-49e1-9d9b-2d5a76183005", "content-length": "1", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91212024-12-12T22:41:26.462ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
91222024-12-12T22:41:26.462ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
91232024-12-12T22:41:26.463ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
91242024-12-12T22:41:26.463ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91252024-12-12T22:41:26.464ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 359.170024ms iteration = 15 status = null
91262024-12-12T22:41:26.486ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 381.743808ms iteration = 15 status = {}
91272024-12-12T22:41:26.502ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
91282024-12-12T22:41:26.522ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
91292024-12-12T22:41:26.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "4ce64571-c0a4-463b-9a62-63cf4d18771f", "content-length": "691", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91302024-12-12T22:41:26.540ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
91312024-12-12T22:41:26.540ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
91322024-12-12T22:41:26.540ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
91332024-12-12T22:41:26.540ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "a805ebd5-3fba-4d0b-93f2-c2c7e0b3322c", "content-length": "372", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91342024-12-12T22:41:26.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91352024-12-12T22:41:26.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91362024-12-12T22:41:26.541ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 436.675407ms iteration = 15 status = {}
91372024-12-12T22:41:26.555ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
91382024-12-12T22:41:26.555ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
91392024-12-12T22:41:26.555ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "69912428-49a5-46a1-9b05-c0f9ec09ee4a", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91402024-12-12T22:41:26.555ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91412024-12-12T22:41:26.555ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91422024-12-12T22:41:26.557ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91432024-12-12T22:41:26.557ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91442024-12-12T22:41:26.560ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
91452024-12-12T22:41:26.560ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
91462024-12-12T22:41:26.565ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
91472024-12-12T22:41:26.565ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
91482024-12-12T22:41:26.565ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "a192d439-d93f-4c75-8bd9-62c7b409f71a", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91492024-12-12T22:41:26.567ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 462.690507ms iteration = 16 status = {}
91502024-12-12T22:41:26.659ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
91512024-12-12T22:41:26.660ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "ba8637c3-205b-4f37-989f-cb14a3a6d1a5", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91522024-12-12T22:41:26.660ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91532024-12-12T22:41:26.661ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "d042f202-4faf-4c5a-af7c-b8da4d87bb08", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91542024-12-12T22:41:26.661ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91552024-12-12T22:41:26.663ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c6b675c8-9567-47c7-99e7-4e50c65e1c56", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91562024-12-12T22:41:26.663ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91572024-12-12T22:41:26.665ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
91582024-12-12T22:41:26.665ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 560.486918ms iteration = 10 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
91592024-12-12T22:41:26.689ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91602024-12-12T22:41:26.689ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91612024-12-12T22:41:26.691ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
91622024-12-12T22:41:26.691ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91632024-12-12T22:41:26.691ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91642024-12-12T22:41:26.702ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
91652024-12-12T22:41:26.702ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "f04bb0b8-a1d4-4a28-932a-cc2682de3738", "content-length": "134", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91662024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
91672024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
91682024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
91692024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
91702024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91712024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91722024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91732024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91742024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
91752024-12-12T22:41:26.702ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
91762024-12-12T22:41:26.703ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
91772024-12-12T22:41:26.703ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91782024-12-12T22:41:26.703ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91792024-12-12T22:41:26.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
91802024-12-12T22:41:26.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "18f1abf5-20ed-4692-8cc1-d3e97561b7e4", "content-length": "2", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91812024-12-12T22:41:26.705ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
91822024-12-12T22:41:26.705ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "62a8aea3-4a75-40ee-8e63-831bc62001e6", "content-length": "52", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91832024-12-12T22:41:26.705ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
91842024-12-12T22:41:26.705ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
91852024-12-12T22:41:26.796ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "4a7f735d-9ae1-4cee-8371-b8920bbd9622", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91862024-12-12T22:41:26.796ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
91872024-12-12T22:41:26.796ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
91882024-12-12T22:41:26.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "ef4d8d86-5dd1-40ee-84be-5840960bea2d", "content-length": "682", "date": "Thu, 12 Dec 2024 22:41:26 GMT"} })
91892024-12-12T22:41:26.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91902024-12-12T22:41:26.797ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91912024-12-12T22:41:26.800ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91922024-12-12T22:41:26.800ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91932024-12-12T22:41:26.803ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91942024-12-12T22:41:26.804ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91952024-12-12T22:41:26.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
91962024-12-12T22:41:26.806ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
91972024-12-12T22:41:26.814ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 709.351592ms iteration = 15 status = {}
91982024-12-12T22:41:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1179 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 243a71d0-70d9-494e-a7ae-af2c307a86cb response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
91992024-12-12T22:41:32.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = f348fa0c-9267-438e-aef6-b941bf0a1fb0 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92002024-12-12T22:41:32.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = f348fa0c-9267-438e-aef6-b941bf0a1fb0 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92012024-12-12T22:41:32.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3357 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = f348fa0c-9267-438e-aef6-b941bf0a1fb0 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92022024-12-12T22:41:32.183ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 07c48d16-1798-431f-b386-2bbd318c7f1d roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92032024-12-12T22:41:32.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 07c48d16-1798-431f-b386-2bbd318c7f1d resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92042024-12-12T22:41:32.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2200 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 07c48d16-1798-431f-b386-2bbd318c7f1d response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92052024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 44 reason = Timeout
92062024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92072024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 44 reason = Timeout
92082024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92092024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92102024-12-12T22:41:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92112024-12-12T22:41:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92122024-12-12T22:41:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92132024-12-12T22:41:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92142024-12-12T22:41:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92152024-12-12T22:41:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92162024-12-12T22:41:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92172024-12-12T22:41:36.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92182024-12-12T22:41:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
92192024-12-12T22:41:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92202024-12-12T22:41:36.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92212024-12-12T22:41:36.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
92222024-12-12T22:41:36.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.824368ms iteration = 44 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
92232024-12-12T22:41:36.133ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92242024-12-12T22:41:36.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92252024-12-12T22:41:36.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.593231ms iteration = 44 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92262024-12-12T22:41:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1202 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 4c3f769d-1071-486f-a279-bdd0a14a76a2 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
92272024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 45 reason = Timeout
92282024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92292024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 45 reason = Timeout
92302024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92312024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92322024-12-12T22:41:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92332024-12-12T22:41:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92342024-12-12T22:41:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
92352024-12-12T22:41:46.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92362024-12-12T22:41:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92372024-12-12T22:41:46.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92382024-12-12T22:41:46.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92392024-12-12T22:41:46.141ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92402024-12-12T22:41:46.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92412024-12-12T22:41:46.147ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
92422024-12-12T22:41:46.149ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
92432024-12-12T22:41:46.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92442024-12-12T22:41:46.149ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92452024-12-12T22:41:46.161ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
92462024-12-12T22:41:46.161ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 56.463269ms iteration = 45 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
92472024-12-12T22:41:46.169ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.794453ms iteration = 45 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
92482024-12-12T22:41:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c78fcfa0-d02b-4141-aac1-daed4e9ae1f3 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92492024-12-12T22:41:47.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c78fcfa0-d02b-4141-aac1-daed4e9ae1f3 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92502024-12-12T22:41:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2852 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c78fcfa0-d02b-4141-aac1-daed4e9ae1f3 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
92512024-12-12T22:41:47.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83802fa5-69f1-4b94-bd08-f50674ddd259 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92522024-12-12T22:41:47.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83802fa5-69f1-4b94-bd08-f50674ddd259 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92532024-12-12T22:41:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2095 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 83802fa5-69f1-4b94-bd08-f50674ddd259 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
92542024-12-12T22:41:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1229 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 2fbededc-ef07-420e-9777-283aef5466e3 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
92552024-12-12T22:41:56.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 16 reason = Timeout
92562024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 16 reason = Timeout
92572024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
92582024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 46 reason = Timeout
92592024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
92602024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 16 reason = Timeout
92612024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
92622024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 46 reason = Timeout
92632024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
92642024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
92652024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 16 reason = Timeout
92662024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 17 reason = Timeout
92672024-12-12T22:41:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
92682024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
92692024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 18 reason = Timeout
92702024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 16 reason = Timeout
92712024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
92722024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 16 reason = Timeout
92732024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
92742024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
92752024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
92762024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 16 reason = Timeout
92772024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
92782024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 16 reason = Timeout
92792024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 16 reason = Timeout
92802024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
92812024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
92822024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
92832024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
92842024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
92852024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
92862024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
92872024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
92882024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
92892024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
92902024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
92912024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
92922024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
92932024-12-12T22:41:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
92942024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 16 reason = Timeout
92952024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 16 reason = Timeout
92962024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
92972024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
92982024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 16 reason = Timeout
92992024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93002024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 16 reason = Timeout
93012024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
93022024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
93032024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93042024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
93052024-12-12T22:41:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93062024-12-12T22:41:56.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.215724ms iteration = 16 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
93072024-12-12T22:41:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93082024-12-12T22:41:56.107ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93092024-12-12T22:41:56.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93102024-12-12T22:41:56.108ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3847, tv_nsec: 30395763 } })
93112024-12-12T22:41:56.108ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
93122024-12-12T22:41:56.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
93132024-12-12T22:41:56.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
93142024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
93152024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93162024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93172024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93182024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93192024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93202024-12-12T22:41:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93212024-12-12T22:41:56.111ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
93222024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
93232024-12-12T22:41:56.112ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93242024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
93252024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93262024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93272024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93282024-12-12T22:41:56.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93292024-12-12T22:41:56.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3847, tv_nsec: 36320189 } })
93302024-12-12T22:41:56.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
93312024-12-12T22:41:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
93322024-12-12T22:41:56.115ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
93332024-12-12T22:41:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
93342024-12-12T22:41:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
93352024-12-12T22:41:56.116ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93362024-12-12T22:41:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93372024-12-12T22:41:56.119ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93382024-12-12T22:41:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93392024-12-12T22:41:56.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93402024-12-12T22:41:56.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3847, tv_nsec: 42699434 } })
93412024-12-12T22:41:56.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
93422024-12-12T22:41:56.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93432024-12-12T22:41:56.121ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93442024-12-12T22:41:56.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
93452024-12-12T22:41:56.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93462024-12-12T22:41:56.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93472024-12-12T22:41:56.132ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
93482024-12-12T22:41:56.132ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 27.103642ms iteration = 16 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
93492024-12-12T22:41:56.141ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93502024-12-12T22:41:56.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93512024-12-12T22:41:56.151ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
93522024-12-12T22:41:56.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 45.649687ms iteration = 16 status = {"errors":[],"records_set_to_done":[]}
93532024-12-12T22:41:56.152ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
93542024-12-12T22:41:56.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93552024-12-12T22:41:56.156ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
93562024-12-12T22:41:56.156ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
93572024-12-12T22:41:56.157ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
93582024-12-12T22:41:56.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
93592024-12-12T22:41:56.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
93602024-12-12T22:41:56.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
93612024-12-12T22:41:56.158ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
93622024-12-12T22:41:56.158ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93632024-12-12T22:41:56.158ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93642024-12-12T22:41:56.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 53.766245ms iteration = 16 status = {"errors":[],"garbage_collect_requested":[]}
93652024-12-12T22:41:56.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 56.579231ms iteration = 46 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
93662024-12-12T22:41:56.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
93672024-12-12T22:41:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
93682024-12-12T22:41:56.163ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
93692024-12-12T22:41:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
93702024-12-12T22:41:56.165ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
93712024-12-12T22:41:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
93722024-12-12T22:41:56.202ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93732024-12-12T22:41:56.202ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93742024-12-12T22:41:56.203ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e346e6f0-14e0-4326-af13-f580cbf785bd", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
93752024-12-12T22:41:56.203ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93762024-12-12T22:41:56.204ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93772024-12-12T22:41:56.221ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
93782024-12-12T22:41:56.221ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
93792024-12-12T22:41:56.222ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
93802024-12-12T22:41:56.222ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93812024-12-12T22:41:56.223ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "43e2cf21-6d73-40be-9d97-45601c2d0c71", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
93822024-12-12T22:41:56.223ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93832024-12-12T22:41:56.225ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
93842024-12-12T22:41:56.231ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
93852024-12-12T22:41:56.231ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
93862024-12-12T22:41:56.231ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "7e0b4ed2-b610-4564-947f-b497ad832298", "content-length": "26", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
93872024-12-12T22:41:56.231ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
93882024-12-12T22:41:56.233ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
93892024-12-12T22:41:56.245ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
93902024-12-12T22:41:56.245ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
93912024-12-12T22:41:56.246ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "69dd5444-d7ed-44fe-92d7-1944a411de2d", "content-length": "372", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
93922024-12-12T22:41:56.246ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
93932024-12-12T22:41:56.246ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
93942024-12-12T22:41:56.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 141.867166ms iteration = 16 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
93952024-12-12T22:41:56.249ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
93962024-12-12T22:41:56.249ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
93972024-12-12T22:41:56.284ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
93982024-12-12T22:41:56.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
93992024-12-12T22:41:56.287ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94002024-12-12T22:41:56.287ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94012024-12-12T22:41:56.288ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94022024-12-12T22:41:56.289ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 184.654297ms iteration = 16 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
94032024-12-12T22:41:56.291ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
94042024-12-12T22:41:56.291ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
94052024-12-12T22:41:56.291ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
94062024-12-12T22:41:56.291ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
94072024-12-12T22:41:56.291ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 186.534734ms iteration = 16 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
94082024-12-12T22:41:56.291ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
94092024-12-12T22:41:56.295ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 189.344939ms iteration = 16 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
94102024-12-12T22:41:56.298ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
94112024-12-12T22:41:56.299ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "835bf3f6-9c7a-4432-a5da-52491d5c9517", "content-length": "1", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94122024-12-12T22:41:56.300ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
94132024-12-12T22:41:56.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
94142024-12-12T22:41:56.303ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 198.203222ms iteration = 16 status = null
94152024-12-12T22:41:56.304ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
94162024-12-12T22:41:56.304ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 199.617821ms iteration = 46 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
94172024-12-12T22:41:56.310ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
94182024-12-12T22:41:56.310ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
94192024-12-12T22:41:56.310ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "844bf62b-ee95-4f38-8007-355de0af307f", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94202024-12-12T22:41:56.310ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94212024-12-12T22:41:56.311ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94222024-12-12T22:41:56.312ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94232024-12-12T22:41:56.313ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94242024-12-12T22:41:56.316ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
94252024-12-12T22:41:56.316ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
94262024-12-12T22:41:56.316ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 211.368651ms iteration = 16 status = {}
94272024-12-12T22:41:56.319ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
94282024-12-12T22:41:56.319ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
94292024-12-12T22:41:56.319ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "69cb6db0-d263-4535-ae9b-a40c5191b809", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94302024-12-12T22:41:56.321ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 216.309929ms iteration = 17 status = {}
94312024-12-12T22:41:56.333ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94322024-12-12T22:41:56.336ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
94332024-12-12T22:41:56.336ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
94342024-12-12T22:41:56.336ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
94352024-12-12T22:41:56.338ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 233.518607ms iteration = 16 status = 0
94362024-12-12T22:41:56.361ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94372024-12-12T22:41:56.361ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94382024-12-12T22:41:56.362ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 257.886405ms iteration = 18 status = {"physical_disks_added":0}
94392024-12-12T22:41:56.384ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94402024-12-12T22:41:56.385ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94412024-12-12T22:41:56.386ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
94422024-12-12T22:41:56.386ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94432024-12-12T22:41:56.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94442024-12-12T22:41:56.394ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94452024-12-12T22:41:56.396ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94462024-12-12T22:41:56.396ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94472024-12-12T22:41:56.396ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94482024-12-12T22:41:56.397ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
94492024-12-12T22:41:56.397ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe88541-947b-4fa5-b5ee-a4ff40316be4", "content-length": "134", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94502024-12-12T22:41:56.397ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
94512024-12-12T22:41:56.397ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
94522024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
94532024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
94542024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94552024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94562024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94572024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94582024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
94592024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
94602024-12-12T22:41:56.398ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
94612024-12-12T22:41:56.398ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94622024-12-12T22:41:56.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94632024-12-12T22:41:56.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
94642024-12-12T22:41:56.401ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "643d35e5-8d11-46ae-9d69-5fbf6fe2843a", "content-length": "2", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94652024-12-12T22:41:56.401ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
94662024-12-12T22:41:56.401ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "0bf4f80d-35bc-41b8-bd8c-5e3241ab19db", "content-length": "52", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94672024-12-12T22:41:56.401ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
94682024-12-12T22:41:56.401ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
94692024-12-12T22:41:56.426ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
94702024-12-12T22:41:56.428ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
94712024-12-12T22:41:56.428ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
94722024-12-12T22:41:56.428ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
94732024-12-12T22:41:56.500ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "934dc6ea-3a55-4c2d-be68-b8e87bd78cef", "date": "Thu, 12 Dec 2024 22:41:56 GMT"} })
94742024-12-12T22:41:56.500ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
94752024-12-12T22:41:56.500ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
94762024-12-12T22:41:56.501ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "871cb637-9df6-43e0-821a-0be681141b2d", "content-length": "682", "date": "Thu, 12 Dec 2024 22:41:56 GMT"} })
94772024-12-12T22:41:56.501ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94782024-12-12T22:41:56.501ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94792024-12-12T22:41:56.504ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94802024-12-12T22:41:56.505ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94812024-12-12T22:41:56.522ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
94822024-12-12T22:41:56.523ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "812fe64c-2f9d-4427-b9db-2f4cc6403dba", "content-length": "691", "date": "Thu, 12 Dec 2024 22:41:55 GMT"} })
94832024-12-12T22:41:56.523ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
94842024-12-12T22:41:56.523ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
94852024-12-12T22:41:56.523ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
94862024-12-12T22:41:56.523ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 418.882297ms iteration = 16 status = {}
94872024-12-12T22:41:56.525ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94882024-12-12T22:41:56.525ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94892024-12-12T22:41:56.527ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
94902024-12-12T22:41:56.527ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
94912024-12-12T22:41:56.535ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 430.370243ms iteration = 16 status = {}
94922024-12-12T22:41:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1040 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = b353097d-578a-4f4c-8147-f7908450e219 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
94932024-12-12T22:42:02.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 445f8e9c-ceb9-46e5-8eb4-32715ac029a0 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
94942024-12-12T22:42:02.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 445f8e9c-ceb9-46e5-8eb4-32715ac029a0 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
94952024-12-12T22:42:02.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3312 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 445f8e9c-ceb9-46e5-8eb4-32715ac029a0 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
94962024-12-12T22:42:02.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d10578a1-f0cc-45cf-bb6e-f87eb06287c3 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
94972024-12-12T22:42:02.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d10578a1-f0cc-45cf-bb6e-f87eb06287c3 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
94982024-12-12T22:42:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2084 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d10578a1-f0cc-45cf-bb6e-f87eb06287c3 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
94992024-12-12T22:42:03.585ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:64058
95002024-12-12T22:42:03.585ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64058 req_id = dace776a-14ec-45ba-bfdb-ad0837368dd4 roles = RoleSet { roles: {} } uri = /metrics/producers
95012024-12-12T22:42:03.586ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64058 req_id = dace776a-14ec-45ba-bfdb-ad0837368dd4 resource = Database result = Ok(()) uri = /metrics/producers
95022024-12-12T22:42:03.624ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = bb9dca28-dea1-4105-b015-9af4a5ccce7e
95032024-12-12T22:42:03.624ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 38450 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:64058 req_id = dace776a-14ec-45ba-bfdb-ad0837368dd4 response_code = 201 uri = /metrics/producers
95042024-12-12T22:42:06.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 47 reason = Timeout
95052024-12-12T22:42:06.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95062024-12-12T22:42:06.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 47 reason = Timeout
95072024-12-12T22:42:06.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95082024-12-12T22:42:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95092024-12-12T22:42:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95102024-12-12T22:42:06.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95112024-12-12T22:42:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95122024-12-12T22:42:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95132024-12-12T22:42:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95142024-12-12T22:42:06.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95152024-12-12T22:42:06.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95162024-12-12T22:42:06.140ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95172024-12-12T22:42:06.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95182024-12-12T22:42:06.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95192024-12-12T22:42:06.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
95202024-12-12T22:42:06.154ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95212024-12-12T22:42:06.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95222024-12-12T22:42:06.167ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
95232024-12-12T22:42:06.167ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 63.227812ms iteration = 47 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
95242024-12-12T22:42:06.176ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 71.980113ms iteration = 47 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95252024-12-12T22:42:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1106 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = f4e5f154-eb2f-4f6a-80c8-f2274cd1dd2d response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
95262024-12-12T22:42:09.793ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
95272024-12-12T22:42:09.793ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
95282024-12-12T22:42:09.824ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
95292024-12-12T22:42:09.824ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:46124
95302024-12-12T22:42:09.824ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46124 req_id = d90a1166-de42-474d-ac78-8ffba295d308 roles = RoleSet { roles: {} } uri = /metrics/producers
95312024-12-12T22:42:09.824ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46124 req_id = d90a1166-de42-474d-ac78-8ffba295d308 resource = Database result = Ok(()) uri = /metrics/producers
95322024-12-12T22:42:09.867ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
95332024-12-12T22:42:09.867ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 43556 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:46124 req_id = d90a1166-de42-474d-ac78-8ffba295d308 response_code = 201 uri = /metrics/producers
95342024-12-12T22:42:09.867ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "d90a1166-de42-474d-ac78-8ffba295d308", "content-length": "41", "date": "Thu, 12 Dec 2024 22:42:09 GMT"} })
95352024-12-12T22:42:09.868ZDEBGnexus (producer-registration-task): registered with nexus successfully
95362024-12-12T22:42:09.868ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
95372024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 48 reason = Timeout
95382024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95392024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 48 reason = Timeout
95402024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95412024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95422024-12-12T22:42:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95432024-12-12T22:42:16.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95442024-12-12T22:42:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
95452024-12-12T22:42:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95462024-12-12T22:42:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95472024-12-12T22:42:16.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95482024-12-12T22:42:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95492024-12-12T22:42:16.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95502024-12-12T22:42:16.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
95512024-12-12T22:42:16.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
95522024-12-12T22:42:16.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
95532024-12-12T22:42:16.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95542024-12-12T22:42:16.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
95552024-12-12T22:42:16.152ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
95562024-12-12T22:42:16.152ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.681087ms iteration = 48 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
95572024-12-12T22:42:16.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.574171ms iteration = 48 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
95582024-12-12T22:42:17.190ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1239 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = af8010ec-d049-49ea-bad9-431ebaafcb27 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
95592024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 17 reason = Timeout
95602024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 17 reason = Timeout
95612024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
95622024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 10 reason = Timeout
95632024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 17 reason = Timeout
95642024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
95652024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
95662024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 9 reason = Timeout
95672024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
95682024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 9 reason = Timeout
95692024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
95702024-12-12T22:42:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
95712024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
95722024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 18 reason = Timeout
95732024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
95742024-12-12T22:42:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
95752024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
95762024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 9 reason = Timeout
95772024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 17 reason = Timeout
95782024-12-12T22:42:26.105ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:32:26.105358676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
95792024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
95802024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
95812024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 17 reason = Timeout
95822024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 10 reason = Timeout
95832024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
95842024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
95852024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 10 reason = Timeout
95862024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
95872024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
95882024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 49 reason = Timeout
95892024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 10 reason = Timeout
95902024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
95912024-12-12T22:42:26.105ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
95922024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 15.47\u{b5}s iteration = 10 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
95932024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 10 reason = Timeout
95942024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 17 reason = Timeout
95952024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 11 reason = Timeout
95962024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
95972024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 49 reason = Timeout
95982024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
95992024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 10 reason = Timeout
96002024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 11 reason = Timeout
96012024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 17 reason = Timeout
96022024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 17 reason = Timeout
96032024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 19 reason = Timeout
96042024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
96052024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
96062024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96072024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 17 reason = Timeout
96082024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
96092024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 9 reason = Timeout
96102024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
96112024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 17 reason = Timeout
96122024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
96132024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 17 reason = Timeout
96142024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 17 reason = Timeout
96152024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
96162024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
96172024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 17 reason = Timeout
96182024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96192024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96202024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 9 reason = Timeout
96212024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
96222024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96232024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
96242024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96252024-12-12T22:42:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96262024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
96272024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96282024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96292024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96302024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96312024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
96322024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
96332024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
96342024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
96352024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
96362024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96372024-12-12T22:42:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3877, tv_nsec: 27968828 } })
96382024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
96392024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
96402024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
96412024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
96422024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
96432024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
96442024-12-12T22:42:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3877, tv_nsec: 28015579 } })
96452024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
96462024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
96472024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
96482024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
96492024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.257355ms iteration = 10 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
96502024-12-12T22:42:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.215624ms iteration = 10 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
96512024-12-12T22:42:26.108ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96522024-12-12T22:42:26.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
96532024-12-12T22:42:26.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
96542024-12-12T22:42:26.108ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96552024-12-12T22:42:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.482168ms iteration = 17 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
96562024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
96572024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
96582024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
96592024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
96602024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
96612024-12-12T22:42:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
96622024-12-12T22:42:26.112ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
96632024-12-12T22:42:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
96642024-12-12T22:42:26.120ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:32:26.105358676 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
96652024-12-12T22:42:26.120ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 14.675348ms iteration = 9 status = {"expiration":"2024-12-12T22:32:26.105358676Z","pruned":[]}
96662024-12-12T22:42:26.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3877, tv_nsec: 44548934 } })
96672024-12-12T22:42:26.123ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
96682024-12-12T22:42:26.123ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 17.450183ms iteration = 9 status = {"errors":[],"found_port_ok":[]}
96692024-12-12T22:42:26.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3877, tv_nsec: 47451291 } })
96702024-12-12T22:42:26.126ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
96712024-12-12T22:42:26.129ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3877, tv_nsec: 51102463 } })
96722024-12-12T22:42:26.129ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
96732024-12-12T22:42:26.162ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
96742024-12-12T22:42:26.162ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
96752024-12-12T22:42:26.162ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
96762024-12-12T22:42:26.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
96772024-12-12T22:42:26.164ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96782024-12-12T22:42:26.166ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
96792024-12-12T22:42:26.166ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
96802024-12-12T22:42:26.166ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
96812024-12-12T22:42:26.166ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96822024-12-12T22:42:26.167ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96832024-12-12T22:42:26.167ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96842024-12-12T22:42:26.167ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96852024-12-12T22:42:26.169ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
96862024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
96872024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
96882024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
96892024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 64.968686ms iteration = 17 status = {"errors":[],"records_set_to_done":[]}
96902024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
96912024-12-12T22:42:26.170ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
96922024-12-12T22:42:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
96932024-12-12T22:42:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
96942024-12-12T22:42:26.171ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
96952024-12-12T22:42:26.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
96962024-12-12T22:42:26.172ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
96972024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
96982024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
96992024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97002024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97012024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97022024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 67.938974ms iteration = 17 status = {"errors":[],"garbage_collect_requested":[]}
97032024-12-12T22:42:26.173ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97042024-12-12T22:42:26.174ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
97052024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
97062024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
97072024-12-12T22:42:26.175ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
97082024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 69.434484ms iteration = 9 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
97092024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97102024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97112024-12-12T22:42:26.175ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97122024-12-12T22:42:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97132024-12-12T22:42:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
97142024-12-12T22:42:26.176ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
97152024-12-12T22:42:26.176ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
97162024-12-12T22:42:26.177ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
97172024-12-12T22:42:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
97182024-12-12T22:42:26.182ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
97192024-12-12T22:42:26.182ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97202024-12-12T22:42:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
97212024-12-12T22:42:26.183ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97222024-12-12T22:42:26.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97232024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
97242024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
97252024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97262024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97272024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
97282024-12-12T22:42:26.184ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97292024-12-12T22:42:26.185ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97302024-12-12T22:42:26.187ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
97312024-12-12T22:42:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
97322024-12-12T22:42:26.190ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
97332024-12-12T22:42:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
97342024-12-12T22:42:26.204ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
97352024-12-12T22:42:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
97362024-12-12T22:42:26.207ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
97372024-12-12T22:42:26.207ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 102.550134ms iteration = 49 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
97382024-12-12T22:42:26.209ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
97392024-12-12T22:42:26.213ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
97402024-12-12T22:42:26.217ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
97412024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
97422024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
97432024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
97442024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
97452024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
97462024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
97472024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97482024-12-12T22:42:26.217ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97492024-12-12T22:42:26.219ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97502024-12-12T22:42:26.221ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
97512024-12-12T22:42:26.221ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
97522024-12-12T22:42:26.221ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 116.249084ms iteration = 9 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
97532024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97542024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97552024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97562024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97572024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 116.803594ms iteration = 49 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
97582024-12-12T22:42:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97592024-12-12T22:42:26.224ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
97602024-12-12T22:42:26.224ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
97612024-12-12T22:42:26.224ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97622024-12-12T22:42:26.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97632024-12-12T22:42:26.224ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
97642024-12-12T22:42:26.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
97652024-12-12T22:42:26.225ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97662024-12-12T22:42:26.225ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97672024-12-12T22:42:26.226ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97682024-12-12T22:42:26.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
97692024-12-12T22:42:26.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
97702024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
97712024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
97722024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
97732024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
97742024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
97752024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97762024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
97772024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
97782024-12-12T22:42:26.229ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
97792024-12-12T22:42:26.230ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97802024-12-12T22:42:26.230ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97812024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
97822024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
97832024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
97842024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
97852024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
97862024-12-12T22:42:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
97872024-12-12T22:42:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
97882024-12-12T22:42:26.233ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
97892024-12-12T22:42:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
97902024-12-12T22:42:26.235ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
97912024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
97922024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
97932024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
97942024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 130.8838ms iteration = 10 status = {"generation":1}
97952024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 130.909651ms iteration = 17 status = 0
97962024-12-12T22:42:26.236ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 130.83723ms iteration = 17 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
97972024-12-12T22:42:26.237ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
97982024-12-12T22:42:26.237ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 132.057663ms iteration = 17 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
97992024-12-12T22:42:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98002024-12-12T22:42:26.237ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98012024-12-12T22:42:26.237ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98022024-12-12T22:42:26.248ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 142.354226ms iteration = 17 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
98032024-12-12T22:42:26.258ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 152.650548ms iteration = 17 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
98042024-12-12T22:42:26.263ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
98052024-12-12T22:42:26.263ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
98062024-12-12T22:42:26.263ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 158.428952ms iteration = 17 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
98072024-12-12T22:42:26.267ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98082024-12-12T22:42:26.267ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98092024-12-12T22:42:26.267ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c6613a13-b14c-45a9-b319-b7297f0d62ae", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:25 GMT"} })
98102024-12-12T22:42:26.267ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98112024-12-12T22:42:26.270ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98122024-12-12T22:42:26.275ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
98132024-12-12T22:42:26.275ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
98142024-12-12T22:42:26.275ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98152024-12-12T22:42:26.275ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98162024-12-12T22:42:26.280ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98172024-12-12T22:42:26.280ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98182024-12-12T22:42:26.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98192024-12-12T22:42:26.283ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
98202024-12-12T22:42:26.283ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
98212024-12-12T22:42:26.283ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
98222024-12-12T22:42:26.301ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
98232024-12-12T22:42:26.301ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 195.860977ms iteration = 9 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
98242024-12-12T22:42:26.342ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 236.75958ms iteration = 19 status = {"physical_disks_added":0}
98252024-12-12T22:42:26.348ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98262024-12-12T22:42:26.348ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98272024-12-12T22:42:26.379ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
98282024-12-12T22:42:26.458ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
98292024-12-12T22:42:26.458ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98302024-12-12T22:42:26.458ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "de22e634-35ae-4df8-a0b5-b0cc3d6d652a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98312024-12-12T22:42:26.458ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98322024-12-12T22:42:26.460ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
98332024-12-12T22:42:26.466ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
98342024-12-12T22:42:26.466ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "b125419b-2c80-48f9-9212-83033920d223", "date": "Thu, 12 Dec 2024 22:42:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98352024-12-12T22:42:26.466ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98362024-12-12T22:42:26.467ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
98372024-12-12T22:42:26.467ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
98382024-12-12T22:42:26.467ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b5c4d479-0525-4c3d-a673-a9c221f2f4d5", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98392024-12-12T22:42:26.467ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
98402024-12-12T22:42:26.468ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "4db1a5a6-ac5f-4ce5-a1f1-487980bd344e", "date": "Thu, 12 Dec 2024 22:42:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98412024-12-12T22:42:26.468ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98422024-12-12T22:42:26.472ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
98432024-12-12T22:42:26.473ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
98442024-12-12T22:42:26.473ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 368.14595ms iteration = 11 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
98452024-12-12T22:42:26.517ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
98462024-12-12T22:42:26.517ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98472024-12-12T22:42:26.519ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "e801c4b5-536f-493d-818a-2b20d449c8c5", "content-length": "372", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98482024-12-12T22:42:26.519ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98492024-12-12T22:42:26.519ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98502024-12-12T22:42:26.519ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98512024-12-12T22:42:26.520ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
98522024-12-12T22:42:26.520ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
98532024-12-12T22:42:26.520ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
98542024-12-12T22:42:26.520ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 415.297247ms iteration = 10 status = {"generation":2}
98552024-12-12T22:42:26.521ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
98562024-12-12T22:42:26.521ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
98572024-12-12T22:42:26.521ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
98582024-12-12T22:42:26.534ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
98592024-12-12T22:42:26.534ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
98602024-12-12T22:42:26.534ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "9d6cc1fb-3751-4727-8819-7c0f06c1a0f4", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98612024-12-12T22:42:26.534ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98622024-12-12T22:42:26.534ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98632024-12-12T22:42:26.535ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
98642024-12-12T22:42:26.535ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6ee2b6e1-f895-4ab0-b677-d946249df465", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98652024-12-12T22:42:26.535ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98662024-12-12T22:42:26.537ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98672024-12-12T22:42:26.537ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98682024-12-12T22:42:26.537ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "b5b43a81-d4bc-4896-9aeb-5662867d628f", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98692024-12-12T22:42:26.537ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98702024-12-12T22:42:26.539ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "c1746142-55c9-4602-8f4e-0a4104ddbdaa", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98712024-12-12T22:42:26.540ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98722024-12-12T22:42:26.540ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
98732024-12-12T22:42:26.540ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
98742024-12-12T22:42:26.542ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
98752024-12-12T22:42:26.542ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 436.703786ms iteration = 11 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
98762024-12-12T22:42:26.544ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
98772024-12-12T22:42:26.544ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
98782024-12-12T22:42:26.544ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "f851b165-9da3-456c-b78e-a8e4acf31ca2", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98792024-12-12T22:42:26.546ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 440.700595ms iteration = 18 status = {}
98802024-12-12T22:42:26.550ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98812024-12-12T22:42:26.552ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98822024-12-12T22:42:26.552ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98832024-12-12T22:42:26.552ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98842024-12-12T22:42:26.555ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
98852024-12-12T22:42:26.555ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 450.210262ms iteration = 10 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
98862024-12-12T22:42:26.581ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
98872024-12-12T22:42:26.581ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 475.931857ms iteration = 17 status = {}
98882024-12-12T22:42:26.581ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e4f4a3d8-ec71-4626-8fb3-7eef0393b556", "content-length": "1", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
98892024-12-12T22:42:26.582ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
98902024-12-12T22:42:26.583ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
98912024-12-12T22:42:26.583ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
98922024-12-12T22:42:26.584ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
98932024-12-12T22:42:26.584ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
98942024-12-12T22:42:26.584ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
98952024-12-12T22:42:26.585ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 479.790123ms iteration = 17 status = null
98962024-12-12T22:42:26.681ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
98972024-12-12T22:42:26.681ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
98982024-12-12T22:42:26.683ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
98992024-12-12T22:42:26.683ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99002024-12-12T22:42:26.683ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99012024-12-12T22:42:26.692ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
99022024-12-12T22:42:26.693ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "df1a157a-a89f-4eae-9a37-2e315b3f9634", "content-length": "691", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99032024-12-12T22:42:26.693ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
99042024-12-12T22:42:26.693ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
99052024-12-12T22:42:26.693ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
99062024-12-12T22:42:26.693ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
99072024-12-12T22:42:26.693ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5f3a54d-bb52-4ee3-8c2d-01b480fa5924", "content-length": "134", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99082024-12-12T22:42:26.693ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
99092024-12-12T22:42:26.693ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
99102024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
99112024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
99122024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99132024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99142024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99152024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99162024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
99172024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
99182024-12-12T22:42:26.694ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 588.914706ms iteration = 17 status = {}
99192024-12-12T22:42:26.694ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
99202024-12-12T22:42:26.694ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99212024-12-12T22:42:26.694ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99222024-12-12T22:42:26.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
99232024-12-12T22:42:26.696ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "8525d364-e8fd-47c5-800b-45e2f5e67811", "content-length": "2", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99242024-12-12T22:42:26.696ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
99252024-12-12T22:42:26.697ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "859a5a43-64f6-48dd-8297-566031836734", "content-length": "52", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99262024-12-12T22:42:26.697ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
99272024-12-12T22:42:26.697ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
99282024-12-12T22:42:26.793ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "9f82d492-6178-45d0-969b-5148fa99d5f1", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99292024-12-12T22:42:26.793ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
99302024-12-12T22:42:26.793ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
99312024-12-12T22:42:26.797ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "d5b84e94-0bf2-4f44-8fcf-d75501e5f836", "content-length": "682", "date": "Thu, 12 Dec 2024 22:42:26 GMT"} })
99322024-12-12T22:42:26.797ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99332024-12-12T22:42:26.798ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99342024-12-12T22:42:26.801ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99352024-12-12T22:42:26.802ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99362024-12-12T22:42:26.805ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99372024-12-12T22:42:26.805ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99382024-12-12T22:42:26.807ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
99392024-12-12T22:42:26.807ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
99402024-12-12T22:42:26.814ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 709.751479ms iteration = 17 status = {}
99412024-12-12T22:42:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1169 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 6381c899-8672-4e94-9e8e-178c6ed9a634 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
99422024-12-12T22:42:32.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = a53062a9-5f14-4147-9a91-7e623669701e roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99432024-12-12T22:42:32.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = a53062a9-5f14-4147-9a91-7e623669701e resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99442024-12-12T22:42:32.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3122 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = a53062a9-5f14-4147-9a91-7e623669701e response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99452024-12-12T22:42:32.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 48f0e5b4-7d2b-48f6-beb5-56a909167713 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99462024-12-12T22:42:32.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 48f0e5b4-7d2b-48f6-beb5-56a909167713 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99472024-12-12T22:42:32.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2413 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 48f0e5b4-7d2b-48f6-beb5-56a909167713 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99482024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 50 reason = Timeout
99492024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99502024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 50 reason = Timeout
99512024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99522024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99532024-12-12T22:42:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99542024-12-12T22:42:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99552024-12-12T22:42:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99562024-12-12T22:42:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99572024-12-12T22:42:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99582024-12-12T22:42:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99592024-12-12T22:42:36.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99602024-12-12T22:42:36.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99612024-12-12T22:42:36.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99622024-12-12T22:42:36.142ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99632024-12-12T22:42:36.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
99642024-12-12T22:42:36.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99652024-12-12T22:42:36.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99662024-12-12T22:42:36.158ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
99672024-12-12T22:42:36.158ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 52.93527ms iteration = 50 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
99682024-12-12T22:42:36.164ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 59.252913ms iteration = 50 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99692024-12-12T22:42:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1098 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = c04b541f-3731-4631-8bb6-a81360574807 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
99702024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 51 reason = Timeout
99712024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99722024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 51 reason = Timeout
99732024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99742024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99752024-12-12T22:42:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99762024-12-12T22:42:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99772024-12-12T22:42:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
99782024-12-12T22:42:46.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99792024-12-12T22:42:46.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99802024-12-12T22:42:46.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99812024-12-12T22:42:46.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99822024-12-12T22:42:46.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
99832024-12-12T22:42:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
99842024-12-12T22:42:46.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
99852024-12-12T22:42:46.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
99862024-12-12T22:42:46.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
99872024-12-12T22:42:46.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.301659ms iteration = 51 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
99882024-12-12T22:42:46.134ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
99892024-12-12T22:42:46.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
99902024-12-12T22:42:46.162ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 57.385987ms iteration = 51 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
99912024-12-12T22:42:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d7f806a5-52c7-427c-8964-99276d8ec249 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99922024-12-12T22:42:47.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d7f806a5-52c7-427c-8964-99276d8ec249 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99932024-12-12T22:42:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2799 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = d7f806a5-52c7-427c-8964-99276d8ec249 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
99942024-12-12T22:42:47.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 24d387cf-1f2a-4396-afac-df0c81dd7680 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99952024-12-12T22:42:47.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 24d387cf-1f2a-4396-afac-df0c81dd7680 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99962024-12-12T22:42:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2305 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 24d387cf-1f2a-4396-afac-df0c81dd7680 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
99972024-12-12T22:42:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1141 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 28c5507b-bc91-40cf-a876-59ec5e48e17f response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
99982024-12-12T22:42:48.529ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:57263
99992024-12-12T22:42:48.529ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57263 req_id = 8f619bec-500e-42b5-9814-8d74d9ef1f96 roles = RoleSet { roles: {} } uri = /metrics/producers
100002024-12-12T22:42:48.529ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57263 req_id = 8f619bec-500e-42b5-9814-8d74d9ef1f96 resource = Database result = Ok(()) uri = /metrics/producers
100012024-12-12T22:42:48.571ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 4a8c9490-d35a-4221-8585-e4103b325118
100022024-12-12T22:42:48.571ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 42709 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:57263 req_id = 8f619bec-500e-42b5-9814-8d74d9ef1f96 response_code = 201 uri = /metrics/producers
100032024-12-12T22:42:55.154ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34381
100042024-12-12T22:42:55.154ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34381 req_id = 64a7a673-55bd-4cf3-881c-917394d34a97 roles = RoleSet { roles: {} } uri = /metrics/producers
100052024-12-12T22:42:55.154ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34381 req_id = 64a7a673-55bd-4cf3-881c-917394d34a97 resource = Database result = Ok(()) uri = /metrics/producers
100062024-12-12T22:42:55.202ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e7680fb8-0ccd-466c-b928-9ebe5b97f2ca
100072024-12-12T22:42:55.202ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 48282 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34381 req_id = 64a7a673-55bd-4cf3-881c-917394d34a97 response_code = 201 uri = /metrics/producers
100082024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 18 reason = Timeout
100092024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100102024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 18 reason = Timeout
100112024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100122024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 52 reason = Timeout
100132024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 19 reason = Timeout
100142024-12-12T22:42:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
100152024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100162024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 18 reason = Timeout
100172024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
100182024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
100192024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 18 reason = Timeout
100202024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 18 reason = Timeout
100212024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100222024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 52 reason = Timeout
100232024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
100242024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 18 reason = Timeout
100252024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 18 reason = Timeout
100262024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
100272024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100282024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
100292024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 20 reason = Timeout
100302024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100312024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 18 reason = Timeout
100322024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
100332024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 18 reason = Timeout
100342024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
100352024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100362024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100372024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
100382024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100392024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100402024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100412024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100422024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
100432024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
100442024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
100452024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
100462024-12-12T22:42:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
100472024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 18 reason = Timeout
100482024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 18 reason = Timeout
100492024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
100502024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
100512024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 18 reason = Timeout
100522024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
100532024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 18 reason = Timeout
100542024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
100552024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
100562024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
100572024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
100582024-12-12T22:42:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
100592024-12-12T22:42:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100602024-12-12T22:42:56.108ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100612024-12-12T22:42:56.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.916297ms iteration = 18 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
100622024-12-12T22:42:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3907, tv_nsec: 31504300 } })
100632024-12-12T22:42:56.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
100642024-12-12T22:42:56.109ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
100652024-12-12T22:42:56.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
100662024-12-12T22:42:56.109ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
100672024-12-12T22:42:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
100682024-12-12T22:42:56.111ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
100692024-12-12T22:42:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
100702024-12-12T22:42:56.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100712024-12-12T22:42:56.114ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3907, tv_nsec: 36354606 } })
100722024-12-12T22:42:56.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
100732024-12-12T22:42:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
100742024-12-12T22:42:56.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100752024-12-12T22:42:56.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100762024-12-12T22:42:56.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3907, tv_nsec: 43846973 } })
100772024-12-12T22:42:56.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
100782024-12-12T22:42:56.124ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100792024-12-12T22:42:56.124ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100802024-12-12T22:42:56.126ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100812024-12-12T22:42:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
100822024-12-12T22:42:56.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
100832024-12-12T22:42:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
100842024-12-12T22:42:56.147ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
100852024-12-12T22:42:56.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
100862024-12-12T22:42:56.153ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
100872024-12-12T22:42:56.153ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 47.794838ms iteration = 52 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
100882024-12-12T22:42:56.155ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
100892024-12-12T22:42:56.155ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
100902024-12-12T22:42:56.155ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
100912024-12-12T22:42:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
100922024-12-12T22:42:56.158ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100932024-12-12T22:42:56.159ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100942024-12-12T22:42:56.159ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
100952024-12-12T22:42:56.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
100962024-12-12T22:42:56.161ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
100972024-12-12T22:42:56.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
100982024-12-12T22:42:56.162ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
100992024-12-12T22:42:56.162ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101002024-12-12T22:42:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101012024-12-12T22:42:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
101022024-12-12T22:42:56.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101032024-12-12T22:42:56.163ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101042024-12-12T22:42:56.164ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101052024-12-12T22:42:56.164ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
101062024-12-12T22:42:56.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101072024-12-12T22:42:56.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
101082024-12-12T22:42:56.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101092024-12-12T22:42:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101102024-12-12T22:42:56.165ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101112024-12-12T22:42:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101122024-12-12T22:42:56.166ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101132024-12-12T22:42:56.166ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.348905ms iteration = 52 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
101142024-12-12T22:42:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
101152024-12-12T22:42:56.169ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
101162024-12-12T22:42:56.169ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
101172024-12-12T22:42:56.172ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
101182024-12-12T22:42:56.172ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 67.326382ms iteration = 18 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
101192024-12-12T22:42:56.172ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101202024-12-12T22:42:56.172ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101212024-12-12T22:42:56.173ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "b8c6dc15-c950-4d8d-a13a-b60ff3a46328", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101222024-12-12T22:42:56.173ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101232024-12-12T22:42:56.174ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101242024-12-12T22:42:56.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101252024-12-12T22:42:56.175ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101262024-12-12T22:42:56.176ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101272024-12-12T22:42:56.176ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101282024-12-12T22:42:56.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101292024-12-12T22:42:56.177ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 71.327681ms iteration = 18 status = {"errors":[],"garbage_collect_requested":[]}
101302024-12-12T22:42:56.178ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101312024-12-12T22:42:56.178ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101322024-12-12T22:42:56.178ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101332024-12-12T22:42:56.179ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
101342024-12-12T22:42:56.179ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101352024-12-12T22:42:56.179ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "21dbac2e-bc9a-43ed-8262-56c71a6c4273", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101362024-12-12T22:42:56.179ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101372024-12-12T22:42:56.180ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
101382024-12-12T22:42:56.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
101392024-12-12T22:42:56.181ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
101402024-12-12T22:42:56.181ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 75.396021ms iteration = 18 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
101412024-12-12T22:42:56.183ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101422024-12-12T22:42:56.185ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
101432024-12-12T22:42:56.185ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
101442024-12-12T22:42:56.185ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
101452024-12-12T22:42:56.185ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5e8bccf0-7ff7-4fce-987f-dd492ee33fac", "content-length": "26", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101462024-12-12T22:42:56.185ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
101472024-12-12T22:42:56.185ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
101482024-12-12T22:42:56.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 79.39859ms iteration = 18 status = {"errors":[],"records_set_to_done":[]}
101492024-12-12T22:42:56.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
101502024-12-12T22:42:56.188ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
101512024-12-12T22:42:56.192ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101522024-12-12T22:42:56.192ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
101532024-12-12T22:42:56.192ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
101542024-12-12T22:42:56.192ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101552024-12-12T22:42:56.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
101562024-12-12T22:42:56.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101572024-12-12T22:42:56.193ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 88.187372ms iteration = 18 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
101582024-12-12T22:42:56.195ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101592024-12-12T22:42:56.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101602024-12-12T22:42:56.197ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101612024-12-12T22:42:56.198ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
101622024-12-12T22:42:56.200ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
101632024-12-12T22:42:56.200ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
101642024-12-12T22:42:56.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
101652024-12-12T22:42:56.201ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
101662024-12-12T22:42:56.201ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101672024-12-12T22:42:56.201ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101682024-12-12T22:42:56.202ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 97.452144ms iteration = 18 status = 0
101692024-12-12T22:42:56.210ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
101702024-12-12T22:42:56.211ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
101712024-12-12T22:42:56.223ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
101722024-12-12T22:42:56.223ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
101732024-12-12T22:42:56.223ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 118.051158ms iteration = 18 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
101742024-12-12T22:42:56.252ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 146.322504ms iteration = 18 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
101752024-12-12T22:42:56.253ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
101762024-12-12T22:42:56.253ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "cecd9221-907a-45e8-bf4e-c297908552d0", "content-length": "1", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101772024-12-12T22:42:56.255ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
101782024-12-12T22:42:56.255ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
101792024-12-12T22:42:56.257ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 152.267871ms iteration = 18 status = null
101802024-12-12T22:42:56.260ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 155.046705ms iteration = 18 status = {}
101812024-12-12T22:42:56.281ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 175.67441ms iteration = 20 status = {"physical_disks_added":0}
101822024-12-12T22:42:56.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
101832024-12-12T22:42:56.343ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
101842024-12-12T22:42:56.343ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
101852024-12-12T22:42:56.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "fff09542-d4de-4352-92b3-ad192a4b70d5", "content-length": "691", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101862024-12-12T22:42:56.344ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
101872024-12-12T22:42:56.344ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
101882024-12-12T22:42:56.344ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
101892024-12-12T22:42:56.344ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "bd985a51-4d0d-49e8-a7e0-d28d47dc72b3", "content-length": "372", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101902024-12-12T22:42:56.344ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101912024-12-12T22:42:56.344ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101922024-12-12T22:42:56.345ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 240.157617ms iteration = 18 status = {}
101932024-12-12T22:42:56.363ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
101942024-12-12T22:42:56.363ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
101952024-12-12T22:42:56.363ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "96166183-6ea1-4626-9284-e68f87849239", "date": "Thu, 12 Dec 2024 22:42:55 GMT"} })
101962024-12-12T22:42:56.363ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101972024-12-12T22:42:56.363ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
101982024-12-12T22:42:56.365ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
101992024-12-12T22:42:56.365ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102002024-12-12T22:42:56.368ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
102012024-12-12T22:42:56.368ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
102022024-12-12T22:42:56.373ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
102032024-12-12T22:42:56.373ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
102042024-12-12T22:42:56.374ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102052024-12-12T22:42:56.374ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102062024-12-12T22:42:56.374ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "84f77f01-b819-40b4-913c-dfeb359bc6ad", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102072024-12-12T22:42:56.376ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 271.021303ms iteration = 19 status = {}
102082024-12-12T22:42:56.376ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
102092024-12-12T22:42:56.376ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102102024-12-12T22:42:56.376ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102112024-12-12T22:42:56.388ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
102122024-12-12T22:42:56.389ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "a9b03c86-f374-4f34-bbdf-3fdf60bd9d91", "content-length": "134", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102132024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
102142024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
102152024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
102162024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
102172024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102182024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102192024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102202024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102212024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
102222024-12-12T22:42:56.389ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
102232024-12-12T22:42:56.390ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
102242024-12-12T22:42:56.390ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102252024-12-12T22:42:56.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102262024-12-12T22:42:56.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
102272024-12-12T22:42:56.391ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "520d9d63-4f60-455d-ad15-ea642d21b00b", "content-length": "2", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102282024-12-12T22:42:56.391ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
102292024-12-12T22:42:56.392ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "39a1dc1a-4e90-4dee-9145-2abe14825998", "content-length": "52", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102302024-12-12T22:42:56.392ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
102312024-12-12T22:42:56.392ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
102322024-12-12T22:42:56.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "8ed68299-4c5e-4d46-8bec-01e4d21889d3", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102332024-12-12T22:42:56.488ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
102342024-12-12T22:42:56.488ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
102352024-12-12T22:42:56.488ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "4cafe7bc-7a7e-44ab-b075-2a69a5f5caa1", "content-length": "682", "date": "Thu, 12 Dec 2024 22:42:56 GMT"} })
102362024-12-12T22:42:56.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102372024-12-12T22:42:56.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102382024-12-12T22:42:56.492ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102392024-12-12T22:42:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102402024-12-12T22:42:56.495ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102412024-12-12T22:42:56.495ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102422024-12-12T22:42:56.497ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
102432024-12-12T22:42:56.497ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
102442024-12-12T22:42:56.505ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 399.816492ms iteration = 18 status = {}
102452024-12-12T22:42:57.188ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1095 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = d1665c29-85c4-4614-bd6f-b2a5ba231410 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
102462024-12-12T22:43:02.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 350d2adc-b7a6-4df8-967a-6437d5a2fa65 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
102472024-12-12T22:43:02.180ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 350d2adc-b7a6-4df8-967a-6437d5a2fa65 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
102482024-12-12T22:43:02.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2968 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 350d2adc-b7a6-4df8-967a-6437d5a2fa65 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
102492024-12-12T22:43:02.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 6b1e0d2c-c840-49be-8e5c-da1a14507f57 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
102502024-12-12T22:43:02.183ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 6b1e0d2c-c840-49be-8e5c-da1a14507f57 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
102512024-12-12T22:43:02.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2725 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 6b1e0d2c-c840-49be-8e5c-da1a14507f57 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
102522024-12-12T22:43:03.169ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:33081
102532024-12-12T22:43:03.169ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33081 req_id = 9d28693e-13a1-4d6d-ac2c-6eb20c5bca88 roles = RoleSet { roles: {} } uri = /metrics/producers
102542024-12-12T22:43:03.169ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33081 req_id = 9d28693e-13a1-4d6d-ac2c-6eb20c5bca88 resource = Database result = Ok(()) uri = /metrics/producers
102552024-12-12T22:43:03.214ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 9be55e3b-79ee-4930-a117-2473cfadb163
102562024-12-12T22:43:03.214ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 45217 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:33081 req_id = 9d28693e-13a1-4d6d-ac2c-6eb20c5bca88 response_code = 201 uri = /metrics/producers
102572024-12-12T22:43:05.338ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:63948
102582024-12-12T22:43:05.338ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63948 req_id = 17ae04aa-a68c-42f1-a46e-08dbc9581f7e roles = RoleSet { roles: {} } uri = /metrics/producers
102592024-12-12T22:43:05.339ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63948 req_id = 17ae04aa-a68c-42f1-a46e-08dbc9581f7e resource = Database result = Ok(()) uri = /metrics/producers
102602024-12-12T22:43:05.349ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = e736935f-49fd-4441-90a4-7226a6f1fe8e
102612024-12-12T22:43:05.349ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 10531 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:63948 req_id = 17ae04aa-a68c-42f1-a46e-08dbc9581f7e response_code = 201 uri = /metrics/producers
102622024-12-12T22:43:06.023ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::1]:62348
102632024-12-12T22:43:06.023ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62348 req_id = 3d5acf2c-c682-46b5-a27d-1a4a43d790a8 roles = RoleSet { roles: {} } uri = /metrics/producers
102642024-12-12T22:43:06.023ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62348 req_id = 3d5acf2c-c682-46b5-a27d-1a4a43d790a8 resource = Database result = Ok(()) uri = /metrics/producers
102652024-12-12T22:43:06.035ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 35574f6f-1e6c-4add-9efb-f5d5c83e2007
102662024-12-12T22:43:06.035ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 12123 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::1]:62348 req_id = 3d5acf2c-c682-46b5-a27d-1a4a43d790a8 response_code = 201 uri = /metrics/producers
102672024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 53 reason = Timeout
102682024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 53 reason = Timeout
102692024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102702024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102712024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102722024-12-12T22:43:06.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102732024-12-12T22:43:06.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102742024-12-12T22:43:06.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102752024-12-12T22:43:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102762024-12-12T22:43:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
102772024-12-12T22:43:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102782024-12-12T22:43:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102792024-12-12T22:43:06.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102802024-12-12T22:43:06.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102812024-12-12T22:43:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102822024-12-12T22:43:06.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
102832024-12-12T22:43:06.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102842024-12-12T22:43:06.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102852024-12-12T22:43:06.126ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
102862024-12-12T22:43:06.126ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 21.177696ms iteration = 53 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
102872024-12-12T22:43:06.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.761124ms iteration = 53 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102882024-12-12T22:43:07.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1078 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 8d017756-1621-4d49-b0aa-5510f8499480 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
102892024-12-12T22:43:16.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 54 reason = Timeout
102902024-12-12T22:43:16.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 54 reason = Timeout
102912024-12-12T22:43:16.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102922024-12-12T22:43:16.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
102932024-12-12T22:43:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102942024-12-12T22:43:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
102952024-12-12T22:43:16.106ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
102962024-12-12T22:43:16.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
102972024-12-12T22:43:16.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
102982024-12-12T22:43:16.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.272134ms iteration = 54 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
102992024-12-12T22:43:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
103002024-12-12T22:43:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103012024-12-12T22:43:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103022024-12-12T22:43:16.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103032024-12-12T22:43:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103042024-12-12T22:43:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
103052024-12-12T22:43:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
103062024-12-12T22:43:16.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103072024-12-12T22:43:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103082024-12-12T22:43:16.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
103092024-12-12T22:43:16.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.467161ms iteration = 54 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
103102024-12-12T22:43:17.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c410019f-28fc-44cc-94f6-9110f6e6e5e2 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
103112024-12-12T22:43:17.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c410019f-28fc-44cc-94f6-9110f6e6e5e2 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
103122024-12-12T22:43:17.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 3127 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = c410019f-28fc-44cc-94f6-9110f6e6e5e2 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
103132024-12-12T22:43:17.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 0e7d6d88-5f8e-45d9-b8a9-b8d246d0666b roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
103142024-12-12T22:43:17.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 0e7d6d88-5f8e-45d9-b8a9-b8d246d0666b resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
103152024-12-12T22:43:17.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2028 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 0e7d6d88-5f8e-45d9-b8a9-b8d246d0666b response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
103162024-12-12T22:43:17.188ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1047 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = c66404ad-212d-4d9d-b754-bd9f329f9125 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
103172024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 19 reason = Timeout
103182024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 19 reason = Timeout
103192024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
103202024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 10 reason = Timeout
103212024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 55 reason = Timeout
103222024-12-12T22:43:26.105ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
103232024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 20 reason = Timeout
103242024-12-12T22:43:26.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
103252024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
103262024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
103272024-12-12T22:43:26.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
103282024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 12 reason = Timeout
103292024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = crdb_node_id_collector iteration = 5 reason = Timeout
103302024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 19 reason = Timeout
103312024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
103322024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103332024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
103342024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 11 reason = Timeout
103352024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
103362024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
103372024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 21 reason = Timeout
103382024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 19 reason = Timeout
103392024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
103402024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
103412024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 19 reason = Timeout
103422024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
103432024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 55 reason = Timeout
103442024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
103452024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 10 reason = Timeout
103462024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
103472024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 19 reason = Timeout
103482024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
103492024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 19 reason = Timeout
103502024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
103512024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 19 reason = Timeout
103522024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
103532024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 10 reason = Timeout
103542024-12-12T22:43:26.106ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:33:26.105771420 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
103552024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
103562024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 11 reason = Timeout
103572024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
103582024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 19 reason = Timeout
103592024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
103602024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 11 reason = Timeout
103612024-12-12T22:43:26.106ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
103622024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 17.75\u{b5}s iteration = 11 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
103632024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 11 reason = Timeout
103642024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
103652024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 12 reason = Timeout
103662024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 11 reason = Timeout
103672024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
103682024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 11 reason = Timeout
103692024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 10 reason = Timeout
103702024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
103712024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 19 reason = Timeout
103722024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
103732024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 19 reason = Timeout
103742024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
103752024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 10 reason = Timeout
103762024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
103772024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 19 reason = Timeout
103782024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
103792024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
103802024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
103812024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 19 reason = Timeout
103822024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
103832024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
103842024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
103852024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
103862024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
103872024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
103882024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
103892024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
103902024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
103912024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
103922024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
103932024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
103942024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
103952024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
103962024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
103972024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
103982024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
103992024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
104002024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104012024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104022024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
104032024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
104042024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104052024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
104062024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
104072024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
104082024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
104092024-12-12T22:43:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3937, tv_nsec: 28490123 } })
104102024-12-12T22:43:26.106ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3937, tv_nsec: 28498253 } })
104112024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104122024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104132024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104142024-12-12T22:43:26.106ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104152024-12-12T22:43:26.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104162024-12-12T22:43:26.107ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
104172024-12-12T22:43:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.396387ms iteration = 11 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
104182024-12-12T22:43:26.107ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
104192024-12-12T22:43:26.107ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.421488ms iteration = 11 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
104202024-12-12T22:43:26.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104212024-12-12T22:43:26.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104222024-12-12T22:43:26.110ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104232024-12-12T22:43:26.110ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 5.488357ms iteration = 19 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
104242024-12-12T22:43:26.111ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104252024-12-12T22:43:26.112ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104262024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
104272024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
104282024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104292024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104302024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104312024-12-12T22:43:26.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104322024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
104332024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
104342024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
104352024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104362024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104372024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
104382024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
104392024-12-12T22:43:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104402024-12-12T22:43:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
104412024-12-12T22:43:26.115ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
104422024-12-12T22:43:26.115ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104432024-12-12T22:43:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
104442024-12-12T22:43:26.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104452024-12-12T22:43:26.118ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
104462024-12-12T22:43:26.118ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
104472024-12-12T22:43:26.118ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
104482024-12-12T22:43:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
104492024-12-12T22:43:26.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
104502024-12-12T22:43:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
104512024-12-12T22:43:26.119ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3937, tv_nsec: 41655822 } })
104522024-12-12T22:43:26.120ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
104532024-12-12T22:43:26.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
104542024-12-12T22:43:26.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
104552024-12-12T22:43:26.122ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104562024-12-12T22:43:26.123ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3937, tv_nsec: 45006977 } })
104572024-12-12T22:43:26.123ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
104582024-12-12T22:43:26.123ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104592024-12-12T22:43:26.124ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
104602024-12-12T22:43:26.124ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
104612024-12-12T22:43:26.125ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:33:26.105771420 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
104622024-12-12T22:43:26.125ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
104632024-12-12T22:43:26.125ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 19.482152ms iteration = 10 status = {"expiration":"2024-12-12T22:33:26.105771420Z","pruned":[]}
104642024-12-12T22:43:26.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104652024-12-12T22:43:26.126ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
104662024-12-12T22:43:26.126ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
104672024-12-12T22:43:26.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
104682024-12-12T22:43:26.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
104692024-12-12T22:43:26.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
104702024-12-12T22:43:26.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
104712024-12-12T22:43:26.130ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
104722024-12-12T22:43:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
104732024-12-12T22:43:26.131ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104742024-12-12T22:43:26.132ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 26.268196ms iteration = 19 status = {"errors":[],"records_set_to_done":[]}
104752024-12-12T22:43:26.133ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 27.618743ms iteration = 10 status = {"errors":[],"found_port_ok":[]}
104762024-12-12T22:43:26.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104772024-12-12T22:43:26.134ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104782024-12-12T22:43:26.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104792024-12-12T22:43:26.136ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104802024-12-12T22:43:26.138ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104812024-12-12T22:43:26.138ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104822024-12-12T22:43:26.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104832024-12-12T22:43:26.139ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104842024-12-12T22:43:26.139ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
104852024-12-12T22:43:26.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
104862024-12-12T22:43:26.140ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104872024-12-12T22:43:26.140ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
104882024-12-12T22:43:26.140ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
104892024-12-12T22:43:26.140ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
104902024-12-12T22:43:26.140ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
104912024-12-12T22:43:26.141ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3937, tv_nsec: 62880709 } })
104922024-12-12T22:43:26.141ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104932024-12-12T22:43:26.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104942024-12-12T22:43:26.141ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
104952024-12-12T22:43:26.141ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
104962024-12-12T22:43:26.141ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
104972024-12-12T22:43:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Fleet result = Ok(())
104982024-12-12T22:43:26.143ZDEBGnexus (BackgroundTasks): roles background_task = crdb_node_id_collector roles = RoleSet { roles: {} }
104992024-12-12T22:43:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = crdb_node_id_collector resource = Database result = Ok(())
105002024-12-12T22:43:26.143ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105012024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
105022024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
105032024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
105042024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105052024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105062024-12-12T22:43:26.145ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105072024-12-12T22:43:26.146ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105082024-12-12T22:43:26.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105092024-12-12T22:43:26.147ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105102024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105112024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105122024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
105132024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105142024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105152024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105162024-12-12T22:43:26.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105172024-12-12T22:43:26.152ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
105182024-12-12T22:43:26.156ZDEBGnexus (BackgroundTasks): activation complete background_task = crdb_node_id_collector elapsed = 50.534652ms iteration = 5 status = {"nsuccess":5}
105192024-12-12T22:43:26.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105202024-12-12T22:43:26.156ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105212024-12-12T22:43:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
105222024-12-12T22:43:26.160ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
105232024-12-12T22:43:26.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
105242024-12-12T22:43:26.161ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
105252024-12-12T22:43:26.161ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105262024-12-12T22:43:26.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105272024-12-12T22:43:26.187ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 80.93006ms iteration = 19 status = {"errors":[],"garbage_collect_requested":[]}
105282024-12-12T22:43:26.189ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105292024-12-12T22:43:26.189ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105302024-12-12T22:43:26.192ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
105312024-12-12T22:43:26.192ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
105322024-12-12T22:43:26.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
105332024-12-12T22:43:26.192ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
105342024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
105352024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
105362024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
105372024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
105382024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
105392024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
105402024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
105412024-12-12T22:43:26.193ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
105422024-12-12T22:43:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
105432024-12-12T22:43:26.194ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
105442024-12-12T22:43:26.194ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
105452024-12-12T22:43:26.194ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 88.809354ms iteration = 10 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
105462024-12-12T22:43:26.195ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
105472024-12-12T22:43:26.195ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
105482024-12-12T22:43:26.195ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 90.051799ms iteration = 10 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
105492024-12-12T22:43:26.199ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
105502024-12-12T22:43:26.199ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 94.024357ms iteration = 19 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
105512024-12-12T22:43:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 96.099738ms iteration = 55 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
105522024-12-12T22:43:26.203ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105532024-12-12T22:43:26.204ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105542024-12-12T22:43:26.207ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105552024-12-12T22:43:26.209ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
105562024-12-12T22:43:26.209ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
105572024-12-12T22:43:26.209ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
105582024-12-12T22:43:26.209ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
105592024-12-12T22:43:26.209ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 104.339769ms iteration = 19 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
105602024-12-12T22:43:26.210ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
105612024-12-12T22:43:26.211ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105622024-12-12T22:43:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
105632024-12-12T22:43:26.214ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
105642024-12-12T22:43:26.214ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
105652024-12-12T22:43:26.215ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
105662024-12-12T22:43:26.215ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
105672024-12-12T22:43:26.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
105682024-12-12T22:43:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
105692024-12-12T22:43:26.220ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
105702024-12-12T22:43:26.225ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
105712024-12-12T22:43:26.228ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
105722024-12-12T22:43:26.228ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
105732024-12-12T22:43:26.244ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105742024-12-12T22:43:26.244ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105752024-12-12T22:43:26.244ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "f5029788-8446-4c6b-9fc1-d074d7020504", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
105762024-12-12T22:43:26.244ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105772024-12-12T22:43:26.247ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105782024-12-12T22:43:26.252ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
105792024-12-12T22:43:26.252ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105802024-12-12T22:43:26.252ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "03917d0d-331c-4dce-b19d-5f14d026a592", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
105812024-12-12T22:43:26.252ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105822024-12-12T22:43:26.255ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
105832024-12-12T22:43:26.273ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 167.843007ms iteration = 21 status = {"physical_disks_added":0}
105842024-12-12T22:43:26.304ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
105852024-12-12T22:43:26.304ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
105862024-12-12T22:43:26.304ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "cc326bea-7486-40b3-a4d5-2de2c1891c72", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
105872024-12-12T22:43:26.304ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
105882024-12-12T22:43:26.306ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
105892024-12-12T22:43:26.321ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
105902024-12-12T22:43:26.321ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
105912024-12-12T22:43:26.321ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "6cd5f01f-3b69-4842-8c5e-a8124bfe6a7a", "content-length": "372", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
105922024-12-12T22:43:26.321ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
105932024-12-12T22:43:26.322ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
105942024-12-12T22:43:26.326ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
105952024-12-12T22:43:26.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
105962024-12-12T22:43:26.337ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
105972024-12-12T22:43:26.337ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 232.148689ms iteration = 55 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
105982024-12-12T22:43:26.355ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
105992024-12-12T22:43:26.356ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 251.069251ms iteration = 19 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
106002024-12-12T22:43:26.357ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106012024-12-12T22:43:26.357ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 251.592721ms iteration = 19 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
106022024-12-12T22:43:26.357ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106032024-12-12T22:43:26.358ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106042024-12-12T22:43:26.358ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 252.356597ms iteration = 19 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
106052024-12-12T22:43:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106062024-12-12T22:43:26.360ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106072024-12-12T22:43:26.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106082024-12-12T22:43:26.363ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
106092024-12-12T22:43:26.363ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
106102024-12-12T22:43:26.364ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106112024-12-12T22:43:26.364ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
106122024-12-12T22:43:26.364ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106132024-12-12T22:43:26.366ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
106142024-12-12T22:43:26.366ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
106152024-12-12T22:43:26.366ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
106162024-12-12T22:43:26.367ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
106172024-12-12T22:43:26.367ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
106182024-12-12T22:43:26.367ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
106192024-12-12T22:43:26.369ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
106202024-12-12T22:43:26.369ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
106212024-12-12T22:43:26.369ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
106222024-12-12T22:43:26.369ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 263.982775ms iteration = 11 status = {"generation":2}
106232024-12-12T22:43:26.369ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 264.24048ms iteration = 19 status = 0
106242024-12-12T22:43:26.384ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
106252024-12-12T22:43:26.384ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "65bc9a4a-5b4e-48ce-beed-1867e3d3b709", "content-length": "1", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
106262024-12-12T22:43:26.386ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
106272024-12-12T22:43:26.386ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
106282024-12-12T22:43:26.386ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
106292024-12-12T22:43:26.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
106302024-12-12T22:43:26.386ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "123383f9-caff-4ce6-b111-15e64fd98fc6", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
106312024-12-12T22:43:26.386ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106322024-12-12T22:43:26.387ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106332024-12-12T22:43:26.389ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 283.623361ms iteration = 19 status = null
106342024-12-12T22:43:26.389ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
106352024-12-12T22:43:26.389ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106362024-12-12T22:43:26.390ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "7701205c-f103-47ed-af7d-9f921abaa784", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106372024-12-12T22:43:26.390ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106382024-12-12T22:43:26.390ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106392024-12-12T22:43:26.391ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
106402024-12-12T22:43:26.391ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "fea46c59-7cd8-4d00-953d-8e3caffb0fff", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106412024-12-12T22:43:26.391ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106422024-12-12T22:43:26.392ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
106432024-12-12T22:43:26.392ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
106442024-12-12T22:43:26.393ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
106452024-12-12T22:43:26.393ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 287.802772ms iteration = 12 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
106462024-12-12T22:43:26.395ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
106472024-12-12T22:43:26.395ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
106482024-12-12T22:43:26.395ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106492024-12-12T22:43:26.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106502024-12-12T22:43:26.396ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
106512024-12-12T22:43:26.396ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
106522024-12-12T22:43:26.396ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "79892abc-ca4a-4c35-a696-b4ee7afddac3", "date": "Thu, 12 Dec 2024 22:43:25 GMT"} })
106532024-12-12T22:43:26.399ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 293.594377ms iteration = 20 status = {}
106542024-12-12T22:43:26.402ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
106552024-12-12T22:43:26.403ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 297.199447ms iteration = 11 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
106562024-12-12T22:43:26.424ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106572024-12-12T22:43:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
106582024-12-12T22:43:26.429ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
106592024-12-12T22:43:26.429ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
106602024-12-12T22:43:26.431ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
106612024-12-12T22:43:26.431ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
106622024-12-12T22:43:26.431ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
106632024-12-12T22:43:26.431ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 325.85589ms iteration = 11 status = {"generation":1}
106642024-12-12T22:43:26.432ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106652024-12-12T22:43:26.433ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
106662024-12-12T22:43:26.433ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 327.322548ms iteration = 10 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
106672024-12-12T22:43:26.433ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106682024-12-12T22:43:26.435ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106692024-12-12T22:43:26.436ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106702024-12-12T22:43:26.436ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106712024-12-12T22:43:26.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106722024-12-12T22:43:26.438ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
106732024-12-12T22:43:26.440ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
106742024-12-12T22:43:26.440ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
106752024-12-12T22:43:26.440ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
106762024-12-12T22:43:26.482ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
106772024-12-12T22:43:26.483ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "cb2cf8c2-18ea-4d56-9510-3dceb80d4905", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106782024-12-12T22:43:26.483ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106792024-12-12T22:43:26.486ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "74c84992-bca2-4639-a430-bb0ce945d9bc", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106802024-12-12T22:43:26.486ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106812024-12-12T22:43:26.488ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "6a35f112-bfbd-44e2-80c2-af55999f7820", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106822024-12-12T22:43:26.488ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106832024-12-12T22:43:26.488ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 383.070744ms iteration = 19 status = {}
106842024-12-12T22:43:26.490ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
106852024-12-12T22:43:26.490ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 384.90767ms iteration = 12 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
106862024-12-12T22:43:26.560ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
106872024-12-12T22:43:26.561ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "8f03b929-7d97-4546-a29b-df458d4c87c9", "content-length": "691", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
106882024-12-12T22:43:26.561ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
106892024-12-12T22:43:26.561ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
106902024-12-12T22:43:26.561ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
106912024-12-12T22:43:26.561ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 456.370703ms iteration = 19 status = {}
106922024-12-12T22:43:26.580ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106932024-12-12T22:43:26.580ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106942024-12-12T22:43:26.582ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
106952024-12-12T22:43:26.582ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
106962024-12-12T22:43:26.582ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
106972024-12-12T22:43:26.590ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
106982024-12-12T22:43:26.591ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "314877d1-92e2-4fed-a18f-16ecfe65000a", "content-length": "134", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
106992024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
107002024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
107012024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
107022024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
107032024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107042024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107052024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107062024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107072024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
107082024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
107092024-12-12T22:43:26.591ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
107102024-12-12T22:43:26.591ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107112024-12-12T22:43:26.592ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107122024-12-12T22:43:26.594ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
107132024-12-12T22:43:26.594ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "9dca5588-734f-4239-b6da-c4147be2ea00", "content-length": "2", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
107142024-12-12T22:43:26.594ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
107152024-12-12T22:43:26.594ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "caca61ce-432f-4a83-b757-851f2af5b579", "content-length": "52", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
107162024-12-12T22:43:26.594ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
107172024-12-12T22:43:26.594ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
107182024-12-12T22:43:26.678ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "e1fecbe2-3bf7-4eef-9e4e-040f9958859e", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
107192024-12-12T22:43:26.678ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
107202024-12-12T22:43:26.678ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
107212024-12-12T22:43:26.678ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "72dab0ba-6814-49ce-81f9-5e70aadd34f4", "content-length": "682", "date": "Thu, 12 Dec 2024 22:43:26 GMT"} })
107222024-12-12T22:43:26.678ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107232024-12-12T22:43:26.679ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107242024-12-12T22:43:26.682ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107252024-12-12T22:43:26.682ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107262024-12-12T22:43:26.686ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107272024-12-12T22:43:26.686ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107282024-12-12T22:43:26.688ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107292024-12-12T22:43:26.688ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
107302024-12-12T22:43:26.695ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 590.584759ms iteration = 19 status = {}
107312024-12-12T22:43:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1082 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 39b91e79-1acc-49ce-9d78-8081bfa1191b response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
107322024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 56 reason = Timeout
107332024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107342024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 56 reason = Timeout
107352024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107362024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107372024-12-12T22:43:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107382024-12-12T22:43:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107392024-12-12T22:43:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107402024-12-12T22:43:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107412024-12-12T22:43:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107422024-12-12T22:43:36.112ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107432024-12-12T22:43:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107442024-12-12T22:43:36.139ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107452024-12-12T22:43:36.139ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107462024-12-12T22:43:36.148ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107472024-12-12T22:43:36.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
107482024-12-12T22:43:36.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107492024-12-12T22:43:36.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107502024-12-12T22:43:36.163ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
107512024-12-12T22:43:36.163ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.566641ms iteration = 56 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
107522024-12-12T22:43:36.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 63.17281ms iteration = 56 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107532024-12-12T22:43:37.190ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1342 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 38d03a3f-1766-4119-9c53-cb52e25ec745 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
107542024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 57 reason = Timeout
107552024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107562024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 57 reason = Timeout
107572024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107582024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107592024-12-12T22:43:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107602024-12-12T22:43:46.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107612024-12-12T22:43:46.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
107622024-12-12T22:43:46.137ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 32.58713ms iteration = 57 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
107632024-12-12T22:43:46.141ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107642024-12-12T22:43:46.144ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
107652024-12-12T22:43:46.144ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107662024-12-12T22:43:46.144ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107672024-12-12T22:43:46.146ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107682024-12-12T22:43:46.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107692024-12-12T22:43:46.149ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
107702024-12-12T22:43:46.151ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
107712024-12-12T22:43:46.151ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107722024-12-12T22:43:46.151ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
107732024-12-12T22:43:46.163ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
107742024-12-12T22:43:46.163ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 58.54473ms iteration = 57 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
107752024-12-12T22:43:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 9c16740f-3688-473e-98c1-9fe9b27e0c14 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
107762024-12-12T22:43:47.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 9c16740f-3688-473e-98c1-9fe9b27e0c14 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
107772024-12-12T22:43:47.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2918 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 9c16740f-3688-473e-98c1-9fe9b27e0c14 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
107782024-12-12T22:43:47.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 801a6183-7b80-4fcb-bc1e-42c33950f070 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
107792024-12-12T22:43:47.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 801a6183-7b80-4fcb-bc1e-42c33950f070 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
107802024-12-12T22:43:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2108 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 801a6183-7b80-4fcb-bc1e-42c33950f070 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
107812024-12-12T22:43:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1152 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 0f9b5fa2-596c-4095-84ef-ec5ca774d548 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
107822024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 20 reason = Timeout
107832024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 20 reason = Timeout
107842024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
107852024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
107862024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
107872024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 58 reason = Timeout
107882024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 20 reason = Timeout
107892024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 58 reason = Timeout
107902024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
107912024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
107922024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 20 reason = Timeout
107932024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
107942024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 20 reason = Timeout
107952024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 20 reason = Timeout
107962024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
107972024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
107982024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 20 reason = Timeout
107992024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108002024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 20 reason = Timeout
108012024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
108022024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 20 reason = Timeout
108032024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
108042024-12-12T22:43:56.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 21 reason = Timeout
108052024-12-12T22:43:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
108062024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108072024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 22 reason = Timeout
108082024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108092024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108102024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108112024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108122024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108132024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
108142024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
108152024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108162024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108172024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108182024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
108192024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108202024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108212024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 20 reason = Timeout
108222024-12-12T22:43:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 20 reason = Timeout
108232024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108242024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 20 reason = Timeout
108252024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
108262024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
108272024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 20 reason = Timeout
108282024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108292024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
108302024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108312024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108322024-12-12T22:43:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
108332024-12-12T22:43:56.107ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 2.327576ms iteration = 20 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
108342024-12-12T22:43:56.107ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108352024-12-12T22:43:56.108ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108362024-12-12T22:43:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3967, tv_nsec: 31658926 } })
108372024-12-12T22:43:56.109ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3967, tv_nsec: 31768648 } })
108382024-12-12T22:43:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
108392024-12-12T22:43:56.110ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
108402024-12-12T22:43:56.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
108412024-12-12T22:43:56.110ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
108422024-12-12T22:43:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
108432024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
108442024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108452024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
108462024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108472024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108482024-12-12T22:43:56.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
108492024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108502024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
108512024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108522024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
108532024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
108542024-12-12T22:43:56.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
108552024-12-12T22:43:56.114ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108562024-12-12T22:43:56.115ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108572024-12-12T22:43:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
108582024-12-12T22:43:56.115ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
108592024-12-12T22:43:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
108602024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
108612024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108622024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108632024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108642024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108652024-12-12T22:43:56.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108662024-12-12T22:43:56.119ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
108672024-12-12T22:43:56.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
108682024-12-12T22:43:56.120ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
108692024-12-12T22:43:56.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
108702024-12-12T22:43:56.122ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3967, tv_nsec: 43894136 } })
108712024-12-12T22:43:56.122ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108722024-12-12T22:43:56.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108732024-12-12T22:43:56.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
108742024-12-12T22:43:56.122ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
108752024-12-12T22:43:56.122ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 17.523034ms iteration = 20 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
108762024-12-12T22:43:56.123ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108772024-12-12T22:43:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108782024-12-12T22:43:56.146ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 40.925754ms iteration = 20 status = {"errors":[],"garbage_collect_requested":[]}
108792024-12-12T22:43:56.147ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
108802024-12-12T22:43:56.147ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
108812024-12-12T22:43:56.147ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
108822024-12-12T22:43:56.147ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
108832024-12-12T22:43:56.152ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 47.381271ms iteration = 20 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
108842024-12-12T22:43:56.156ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108852024-12-12T22:43:56.156ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108862024-12-12T22:43:56.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108872024-12-12T22:43:56.158ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 52.067963ms iteration = 20 status = {"errors":[],"records_set_to_done":[]}
108882024-12-12T22:43:56.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108892024-12-12T22:43:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108902024-12-12T22:43:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
108912024-12-12T22:43:56.159ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
108922024-12-12T22:43:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
108932024-12-12T22:43:56.162ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
108942024-12-12T22:43:56.162ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
108952024-12-12T22:43:56.163ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
108962024-12-12T22:43:56.163ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
108972024-12-12T22:43:56.164ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
108982024-12-12T22:43:56.165ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
108992024-12-12T22:43:56.165ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109002024-12-12T22:43:56.165ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109012024-12-12T22:43:56.165ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109022024-12-12T22:43:56.165ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 61.016778ms iteration = 58 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
109032024-12-12T22:43:56.167ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109042024-12-12T22:43:56.167ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
109052024-12-12T22:43:56.167ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
109062024-12-12T22:43:56.168ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
109072024-12-12T22:43:56.168ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 62.988657ms iteration = 20 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
109082024-12-12T22:43:56.171ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
109092024-12-12T22:43:56.171ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
109102024-12-12T22:43:56.171ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
109112024-12-12T22:43:56.176ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 71.934282ms iteration = 20 status = 0
109122024-12-12T22:43:56.184ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
109132024-12-12T22:43:56.184ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 79.851989ms iteration = 58 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
109142024-12-12T22:43:56.188ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109152024-12-12T22:43:56.188ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
109162024-12-12T22:43:56.188ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
109172024-12-12T22:43:56.188ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
109182024-12-12T22:43:56.193ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109192024-12-12T22:43:56.193ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109202024-12-12T22:43:56.193ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1867727-5c63-4308-a5eb-147a206bf952", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109212024-12-12T22:43:56.194ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109222024-12-12T22:43:56.194ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
109232024-12-12T22:43:56.194ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109242024-12-12T22:43:56.195ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee04ac22-978b-4d3a-a19c-63298019ea2a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109252024-12-12T22:43:56.195ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109262024-12-12T22:43:56.196ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109272024-12-12T22:43:56.197ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 91.234171ms iteration = 20 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
109282024-12-12T22:43:56.197ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
109292024-12-12T22:43:56.211ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
109302024-12-12T22:43:56.211ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
109312024-12-12T22:43:56.211ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "e286da8b-a8d1-4af3-8e04-d5394d60b11f", "content-length": "26", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109322024-12-12T22:43:56.211ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
109332024-12-12T22:43:56.213ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
109342024-12-12T22:43:56.227ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109352024-12-12T22:43:56.227ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109362024-12-12T22:43:56.268ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
109372024-12-12T22:43:56.268ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109382024-12-12T22:43:56.271ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 166.086762ms iteration = 22 status = {"physical_disks_added":0}
109392024-12-12T22:43:56.277ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109402024-12-12T22:43:56.277ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109412024-12-12T22:43:56.279ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109422024-12-12T22:43:56.280ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "de496c81-506f-4720-8085-181d89745de7", "content-length": "372", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109432024-12-12T22:43:56.280ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109442024-12-12T22:43:56.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109452024-12-12T22:43:56.281ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109462024-12-12T22:43:56.281ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109472024-12-12T22:43:56.281ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109482024-12-12T22:43:56.282ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
109492024-12-12T22:43:56.284ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
109502024-12-12T22:43:56.284ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
109512024-12-12T22:43:56.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
109522024-12-12T22:43:56.295ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
109532024-12-12T22:43:56.295ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
109542024-12-12T22:43:56.295ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
109552024-12-12T22:43:56.296ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b02f2b2-10c7-4ac6-896c-2a7d9687c1f4", "content-length": "1", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109562024-12-12T22:43:56.296ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "5b488759-4c81-48cf-bbe8-e89184066528", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109572024-12-12T22:43:56.296ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109582024-12-12T22:43:56.296ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109592024-12-12T22:43:56.297ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
109602024-12-12T22:43:56.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
109612024-12-12T22:43:56.298ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
109622024-12-12T22:43:56.298ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
109632024-12-12T22:43:56.298ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 193.611872ms iteration = 20 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
109642024-12-12T22:43:56.298ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109652024-12-12T22:43:56.298ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109662024-12-12T22:43:56.299ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 194.225935ms iteration = 20 status = {}
109672024-12-12T22:43:56.299ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 194.269966ms iteration = 20 status = null
109682024-12-12T22:43:56.301ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
109692024-12-12T22:43:56.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
109702024-12-12T22:43:56.305ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
109712024-12-12T22:43:56.305ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
109722024-12-12T22:43:56.305ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "8a3e9bc0-6d4d-4421-ad96-d3074611d020", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109732024-12-12T22:43:56.307ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 202.978046ms iteration = 21 status = {}
109742024-12-12T22:43:56.330ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
109752024-12-12T22:43:56.331ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "0868135e-1904-4b05-8855-66203ad9d375", "content-length": "691", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109762024-12-12T22:43:56.331ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
109772024-12-12T22:43:56.331ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
109782024-12-12T22:43:56.331ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
109792024-12-12T22:43:56.333ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 228.701522ms iteration = 20 status = {}
109802024-12-12T22:43:56.371ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109812024-12-12T22:43:56.371ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109822024-12-12T22:43:56.373ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
109832024-12-12T22:43:56.373ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109842024-12-12T22:43:56.373ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
109852024-12-12T22:43:56.383ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
109862024-12-12T22:43:56.383ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "c562edde-fe39-408b-8b52-3f02c6bbb9b1", "content-length": "134", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
109872024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
109882024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
109892024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
109902024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
109912024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109922024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109932024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109942024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109952024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
109962024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
109972024-12-12T22:43:56.383ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
109982024-12-12T22:43:56.383ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
109992024-12-12T22:43:56.384ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110002024-12-12T22:43:56.385ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
110012024-12-12T22:43:56.385ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d54ac8b0-da4a-4c98-9edc-7671750f0b38", "content-length": "2", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
110022024-12-12T22:43:56.386ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
110032024-12-12T22:43:56.386ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "dbffd64a-14df-45d9-bfdf-de3346013bce", "content-length": "52", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
110042024-12-12T22:43:56.386ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
110052024-12-12T22:43:56.386ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
110062024-12-12T22:43:56.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "05934712-6371-4d30-8f5d-7982af6aaafa", "date": "Thu, 12 Dec 2024 22:43:56 GMT"} })
110072024-12-12T22:43:56.484ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
110082024-12-12T22:43:56.484ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
110092024-12-12T22:43:56.484ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "7d9382b3-de02-4c61-b349-3e00e54d87d9", "content-length": "682", "date": "Thu, 12 Dec 2024 22:43:55 GMT"} })
110102024-12-12T22:43:56.484ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110112024-12-12T22:43:56.485ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110122024-12-12T22:43:56.488ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110132024-12-12T22:43:56.488ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110142024-12-12T22:43:56.491ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110152024-12-12T22:43:56.492ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110162024-12-12T22:43:56.494ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110172024-12-12T22:43:56.494ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
110182024-12-12T22:43:56.502ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 397.485557ms iteration = 20 status = {}
110192024-12-12T22:43:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1049 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = e1fb639b-499d-407f-8da4-f91eec3431f3 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
110202024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 59 reason = Timeout
110212024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110222024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 59 reason = Timeout
110232024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110242024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110252024-12-12T22:44:06.104ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110262024-12-12T22:44:06.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110272024-12-12T22:44:06.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110282024-12-12T22:44:06.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110292024-12-12T22:44:06.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.757944ms iteration = 59 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110302024-12-12T22:44:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110312024-12-12T22:44:06.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110322024-12-12T22:44:06.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110332024-12-12T22:44:06.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110342024-12-12T22:44:06.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110352024-12-12T22:44:06.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110362024-12-12T22:44:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
110372024-12-12T22:44:06.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110382024-12-12T22:44:06.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110392024-12-12T22:44:06.124ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
110402024-12-12T22:44:06.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.473792ms iteration = 59 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
110412024-12-12T22:44:07.188ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1086 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 9b402093-fe1e-4a51-8746-7ddea1e6eecd response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
110422024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 60 reason = Timeout
110432024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110442024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 60 reason = Timeout
110452024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110462024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110472024-12-12T22:44:16.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110482024-12-12T22:44:16.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110492024-12-12T22:44:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
110502024-12-12T22:44:16.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110512024-12-12T22:44:16.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110522024-12-12T22:44:16.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110532024-12-12T22:44:16.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110542024-12-12T22:44:16.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
110552024-12-12T22:44:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
110562024-12-12T22:44:16.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
110572024-12-12T22:44:16.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
110582024-12-12T22:44:16.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
110592024-12-12T22:44:16.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.415551ms iteration = 60 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
110602024-12-12T22:44:16.132ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110612024-12-12T22:44:16.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
110622024-12-12T22:44:16.134ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 29.592561ms iteration = 60 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
110632024-12-12T22:44:17.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3facb162-dea7-421f-8a70-84e45155d3b2 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
110642024-12-12T22:44:17.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3facb162-dea7-421f-8a70-84e45155d3b2 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
110652024-12-12T22:44:17.182ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2629 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3facb162-dea7-421f-8a70-84e45155d3b2 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
110662024-12-12T22:44:17.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = fc4165f3-f5cd-4309-a093-89317489ac5a roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
110672024-12-12T22:44:17.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = fc4165f3-f5cd-4309-a093-89317489ac5a resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
110682024-12-12T22:44:17.185ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2953 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = fc4165f3-f5cd-4309-a093-89317489ac5a response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
110692024-12-12T22:44:17.188ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1135 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 1d091fb1-cf52-4b78-9fe4-0707abc1a3c4 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
110702024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 21 reason = Timeout
110712024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_internal dns_group = internal iteration = 13 reason = Timeout
110722024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
110732024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = decommissioned_disk_cleaner iteration = 11 reason = Timeout
110742024-12-12T22:44:26.104ZINFOnexus (BackgroundTasks): Decommissioned disk cleaner running background_task = decommissioned_disk_cleaner file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:56
110752024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
110762024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = metrics_producer_gc iteration = 11 reason = Timeout
110772024-12-12T22:44:26.104ZINFOnexus (BackgroundTasks): Metric producer GC running background_task = metrics_producer_gc expiration = 2024-12-12 22:34:26.104815306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:48
110782024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = external_endpoints iteration = 12 reason = Timeout
110792024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = metrics_producer_gc roles = RoleSet { roles: {} }
110802024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
110812024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 22 reason = Timeout
110822024-12-12T22:44:26.104ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
110832024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
110842024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_executor iteration = 12 reason = Timeout
110852024-12-12T22:44:26.104ZWARNnexus (BackgroundTasks): Blueprint execution: skipped background_task = blueprint_executor file = nexus/src/app/background/tasks/blueprint_execution.rs:83 reason = blueprint disabled target_id = 9340586b-e531-4e39-8dbf-b547c38f365c
110862024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_external dns_group = external iteration = 12 reason = Timeout
110872024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_executor elapsed = 12.571\u{b5}s iteration = 12 status = {"enabled":false,"target_id":"9340586b-e531-4e39-8dbf-b547c38f365c"}
110882024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_internal dns_group = internal iteration = 12 reason = Timeout
110892024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_internal dns_group = internal
110902024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 61 reason = Timeout
110912024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
110922024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
110932024-12-12T22:44:26.104ZDEBGnexus (BackgroundTasks): activating background_task = inventory_collection iteration = 3 reason = Timeout
110942024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
110952024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_firewall_rule_propagation iteration = 3 reason = Timeout
110962024-12-12T22:44:26.105ZDEBGnexus (service-firewall-rule-progator): starting background task for service firewall rule propagation background_task = service_firewall_rule_propagation
110972024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
110982024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_config_external dns_group = external iteration = 12 reason = Timeout
110992024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): reading DNS version background_task = dns_config_external dns_group = external
111002024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111012024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 61 reason = Timeout
111022024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
111032024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 21 reason = Timeout
111042024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
111052024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_servers_internal dns_group = internal iteration = 12 reason = Timeout
111062024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = dns_propagation_external dns_group = external iteration = 13 reason = Timeout
111072024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 21 reason = Timeout
111082024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 21 reason = Timeout
111092024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
111102024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 23 reason = Timeout
111112024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_reincarnation iteration = 11 reason = Timeout
111122024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 21 reason = Timeout
111132024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
111142024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
111152024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
111162024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 21 reason = Timeout
111172024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
111182024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 21 reason = Timeout
111192024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
111202024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
111212024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 21 reason = Timeout
111222024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 21 reason = Timeout
111232024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
111242024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
111252024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111262024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111272024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = metrics_producer_gc resource = Database result = Ok(())
111282024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111292024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111302024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = abandoned_vmm_reaper iteration = 11 reason = Timeout
111312024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = abandoned_vmm_reaper roles = RoleSet { roles: {} }
111322024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 21 reason = Timeout
111332024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111342024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
111352024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 21 reason = Timeout
111362024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 21 reason = Timeout
111372024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
111382024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
111392024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = saga_recovery iteration = 2 reason = Timeout
111402024-12-12T22:44:26.105ZDEBGnexus (SagaRecoverer): listing candidate sagas for recovery
111412024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 21 reason = Timeout
111422024-12-12T22:44:26.105ZDEBGnexus (SagaRecoverer): roles roles = RoleSet { roles: {} }
111432024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
111442024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activating background_task = lookup_region_port iteration = 11 reason = Timeout
111452024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): roles background_task = lookup_region_port roles = RoleSet { roles: {} }
111462024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111472024-12-12T22:44:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _external-dns._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_external-dns._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("6ed7f70e-6e55-43a0-a74c-b5cd82afb24a.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_external-dns._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("fccfaa8c-ea2a-4fac-967f-e43007ddb28d.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::8))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 27286504 } })
111482024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
111492024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
111502024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111512024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
111522024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
111532024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
111542024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
111552024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
111562024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
111572024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
111582024-12-12T22:44:26.105ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _nameservice._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_nameservice._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("274d5912-4a70-4fa9-bda4-a3ea3c10fa1d.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("7160cbb3-b56f-4e07-9380-65c1eba185bc.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("_nameservice._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 5353, target: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("c29982ca-1c1c-420b-ace3-c75702fa0579.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:2::1))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 27465497 } })
111592024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
111602024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
111612024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
111622024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
111632024-12-12T22:44:26.105ZDEBGnexus (SagaRecoverer): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000003a8a, .. }) resource = Database result = Ok(())
111642024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
111652024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = abandoned_vmm_reaper resource = Database result = Ok(())
111662024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
111672024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = lookup_region_port resource = Database result = Ok(())
111682024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
111692024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } background_task = dns_servers_external current_servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } dns_group = external
111702024-12-12T22:44:26.105ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_external dns_group = external elapsed = 1.04031ms iteration = 12 status = {"addresses":["[fd00:1122:3344:101::9]:5353","[fd00:1122:3344:101::8]:5353"]}
111712024-12-12T22:44:26.106ZDEBGnexus (BackgroundTasks): found DNS servers (no change) addresses = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } background_task = dns_servers_internal current_servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } dns_group = internal
111722024-12-12T22:44:26.106ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_servers_internal dns_group = internal elapsed = 1.190883ms iteration = 12 status = {"addresses":["[fd00:1122:3344:1::1]:5353","[fd00:1122:3344:3::1]:5353","[fd00:1122:3344:2::1]:5353"]}
111732024-12-12T22:44:26.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111742024-12-12T22:44:26.108ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111752024-12-12T22:44:26.108ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
111762024-12-12T22:44:26.109ZINFOnexus (BackgroundTasks): Metric producer GC complete (no errors) background_task = metrics_producer_gc expiration = 2024-12-12 22:34:26.104815306 UTC file = nexus/src/app/background/tasks/metrics_producer_gc.rs:69 pruned = {}
111772024-12-12T22:44:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = metrics_producer_gc elapsed = 4.217543ms iteration = 11 status = {"expiration":"2024-12-12T22:34:26.104815306Z","pruned":[]}
111782024-12-12T22:44:26.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
111792024-12-12T22:44:26.109ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 4.135301ms iteration = 21 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
111802024-12-12T22:44:26.109ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111812024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
111822024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
111832024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
111842024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
111852024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
111862024-12-12T22:44:26.110ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
111872024-12-12T22:44:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
111882024-12-12T22:44:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
111892024-12-12T22:44:26.111ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
111902024-12-12T22:44:26.111ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
111912024-12-12T22:44:26.111ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
111922024-12-12T22:44:26.112ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111932024-12-12T22:44:26.112ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
111942024-12-12T22:44:26.113ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
111952024-12-12T22:44:26.113ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111962024-12-12T22:44:26.114ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
111972024-12-12T22:44:26.114ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
111982024-12-12T22:44:26.114ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
111992024-12-12T22:44:26.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Fleet result = Ok(())
112002024-12-12T22:44:26.115ZDEBGnexus (BackgroundTasks): roles background_task = decommissioned_disk_cleaner roles = RoleSet { roles: {} }
112012024-12-12T22:44:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = decommissioned_disk_cleaner resource = Database result = Ok(())
112022024-12-12T22:44:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
112032024-12-12T22:44:26.116ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
112042024-12-12T22:44:26.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
112052024-12-12T22:44:26.117ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112062024-12-12T22:44:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
112072024-12-12T22:44:26.117ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112082024-12-12T22:44:26.117ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112092024-12-12T22:44:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
112102024-12-12T22:44:26.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
112112024-12-12T22:44:26.119ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
112122024-12-12T22:44:26.119ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112132024-12-12T22:44:26.121ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 43034063 } })
112142024-12-12T22:44:26.121ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
112152024-12-12T22:44:26.121ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
112162024-12-12T22:44:26.121ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112172024-12-12T22:44:26.121ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 43808158 } })
112182024-12-12T22:44:26.122ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112192024-12-12T22:44:26.122ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
112202024-12-12T22:44:26.122ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 16.82336ms iteration = 21 status = {"errors":[],"garbage_collect_requested":[]}
112212024-12-12T22:44:26.125ZDEBGnexus (BackgroundTasks): activation complete background_task = lookup_region_port elapsed = 20.37014ms iteration = 11 status = {"errors":[],"found_port_ok":[]}
112222024-12-12T22:44:26.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112232024-12-12T22:44:26.127ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
112242024-12-12T22:44:26.127ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
112252024-12-12T22:44:26.127ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112262024-12-12T22:44:26.127ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112272024-12-12T22:44:26.128ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112282024-12-12T22:44:26.128ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 50465009 } })
112292024-12-12T22:44:26.128ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
112302024-12-12T22:44:26.130ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112312024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_internal dns_group = internal version = 1
112322024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_internal dns_group = internal
112332024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_internal dns_group = internal
112342024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112352024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 27.071041ms iteration = 61 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
112362024-12-12T22:44:26.131ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112372024-12-12T22:44:26.132ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112382024-12-12T22:44:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112392024-12-12T22:44:26.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
112402024-12-12T22:44:26.137ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112412024-12-12T22:44:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112422024-12-12T22:44:26.137ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
112432024-12-12T22:44:26.137ZDEBGnexus (BackgroundTasks): inventory_prune_one: nothing eligible for removal (too few) background_task = inventory_collection candidates = [(2ce21300-7dcf-418c-a128-85db2b099fe9, 0), (c029b21e-d915-4f0d-b82b-7da93544911b, 0), (6909cce4-7098-4f89-96e9-4f84fb85b683, 0)]
112442024-12-12T22:44:26.137ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
112452024-12-12T22:44:26.138ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112462024-12-12T22:44:26.138ZDEBGnexus (DnsResolver): lookup_all_socket_v6 srv dns_name = _mgs._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_mgs._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_mgs._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12225, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 3997, tv_nsec: 60127109 } })
112472024-12-12T22:44:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = DnsConfig result = Ok(())
112482024-12-12T22:44:26.142ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
112492024-12-12T22:44:26.142ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
112502024-12-12T22:44:26.148ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112512024-12-12T22:44:26.152ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112522024-12-12T22:44:26.154ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
112532024-12-12T22:44:26.154ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
112542024-12-12T22:44:26.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
112552024-12-12T22:44:26.154ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112562024-12-12T22:44:26.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112572024-12-12T22:44:26.156ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
112582024-12-12T22:44:26.156ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
112592024-12-12T22:44:26.156ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
112602024-12-12T22:44:26.159ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112612024-12-12T22:44:26.161ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112622024-12-12T22:44:26.166ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112632024-12-12T22:44:26.167ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112642024-12-12T22:44:26.169ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112652024-12-12T22:44:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
112662024-12-12T22:44:26.174ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112672024-12-12T22:44:26.174ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112682024-12-12T22:44:26.176ZINFOnexus (SagaRecoverer): listed in-progress sagas count = 0 file = nexus/src/app/background/tasks/saga_recovery.rs:438
112692024-12-12T22:44:26.176ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = 7115a405-035b-4f4e-a521-2f919358b720
112702024-12-12T22:44:26.176ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
112712024-12-12T22:44:26.176ZINFOnexus (BackgroundTasks): observed saga start background_task = saga_recovery file = nexus/saga-recovery/src/recovery.rs:76 saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
112722024-12-12T22:44:26.176ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = 7115a405-035b-4f4e-a521-2f919358b720
112732024-12-12T22:44:26.176ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = b7274254-9ab5-4831-aee0-d40919b9b980
112742024-12-12T22:44:26.177ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112752024-12-12T22:44:26.177ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112762024-12-12T22:44:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112772024-12-12T22:44:26.177ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112782024-12-12T22:44:26.179ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 74.567945ms iteration = 21 status = {"errors":[],"records_set_to_done":[]}
112792024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): Found abandoned VMMs background_task = abandoned_vmm_reaper count = 0 total = 0
112802024-12-12T22:44:26.180ZINFOnexus (BackgroundTasks): Abandoned VMMs reaped background_task = abandoned_vmm_reaper file = nexus/src/app/background/tasks/abandoned_vmm_reaper.rs:171 sled_reservations_deleted = 0 vmms_already_deleted = 0 vmms_deleted = 0 vmms_found = 0
112812024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): activation complete background_task = abandoned_vmm_reaper elapsed = 74.749588ms iteration = 11 status = {"errors":[],"sled_reservations_deleted":0,"vmms_already_deleted":0,"vmms_deleted":0,"vmms_found":0}
112822024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
112832024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): found saga that may be done (will be sure on the next pass) background_task = saga_recovery saga_id = cea51ca0-5a94-44f5-8523-30b1cf793f17
112842024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): activation complete background_task = saga_recovery elapsed = 75.420032ms iteration = 2 status = {"last_pass":{"Success":{"nfailed":0,"nfound":0,"nrecovered":0,"nremoved":0,"nskipped":0}},"ntotal_failures":0,"ntotal_finished":0,"ntotal_recovered":0,"ntotal_sec_errors_bad_state":0,"ntotal_sec_errors_missing":0,"ntotal_started":3,"recent_failures":[],"recent_recoveries":[]}
112852024-12-12T22:44:26.180ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
112862024-12-12T22:44:26.182ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112872024-12-12T22:44:26.182ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
112882024-12-12T22:44:26.182ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
112892024-12-12T22:44:26.182ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
112902024-12-12T22:44:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
112912024-12-12T22:44:26.182ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
112922024-12-12T22:44:26.183ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
112932024-12-12T22:44:26.183ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
112942024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
112952024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112962024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 80.269787ms iteration = 61 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
112972024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
112982024-12-12T22:44:26.185ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
112992024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
113002024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
113012024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
113022024-12-12T22:44:26.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 80.495481ms iteration = 21 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
113032024-12-12T22:44:26.187ZDEBGnexus (BackgroundTasks): Found zpools on decommissioned disks background_task = decommissioned_disk_cleaner count = 0
113042024-12-12T22:44:26.187ZINFOnexus (BackgroundTasks): Cleaned decommissioned zpools background_task = decommissioned_disk_cleaner deleted = 0 error_count = 0 file = nexus/src/app/background/tasks/decommissioned_disk_cleaner.rs:140 found = 0 not_ready_to_be_deleted = 0
113052024-12-12T22:44:26.187ZDEBGnexus (BackgroundTasks): activation complete background_task = decommissioned_disk_cleaner elapsed = 82.723275ms iteration = 11 status = {"deleted":0,"error":null,"error_count":0,"found":0,"not_ready_to_be_deleted":0}
113062024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): found DNS version background_task = dns_config_external dns_group = external version = 2
113072024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): reading DNS config background_task = dns_config_external dns_group = external
113082024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): reading DNS zones background_task = dns_config_external dns_group = external
113092024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113102024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
113112024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113122024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113132024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113142024-12-12T22:44:26.190ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113152024-12-12T22:44:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113162024-12-12T22:44:26.191ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113172024-12-12T22:44:26.192ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113182024-12-12T22:44:26.192ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113192024-12-12T22:44:26.193ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113202024-12-12T22:44:26.194ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113212024-12-12T22:44:26.194ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113222024-12-12T22:44:26.195ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113232024-12-12T22:44:26.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113242024-12-12T22:44:26.195ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113252024-12-12T22:44:26.195ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113262024-12-12T22:44:26.196ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
113272024-12-12T22:44:26.196ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
113282024-12-12T22:44:26.196ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
113292024-12-12T22:44:26.196ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
113302024-12-12T22:44:26.197ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
113312024-12-12T22:44:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
113322024-12-12T22:44:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
113332024-12-12T22:44:26.197ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113342024-12-12T22:44:26.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113352024-12-12T22:44:26.200ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113362024-12-12T22:44:26.200ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113372024-12-12T22:44:26.200ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113382024-12-12T22:44:26.201ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
113392024-12-12T22:44:26.201ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 96.184419ms iteration = 21 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
113402024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 96.810791ms iteration = 21 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
113412024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_external count = 1 dns_group = external
113422024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_external batch_size = 100 dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 0 version = 2
113432024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
113442024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
113452024-12-12T22:44:26.202ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113462024-12-12T22:44:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113472024-12-12T22:44:26.203ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Fleet result = Ok(())
113482024-12-12T22:44:26.203ZDEBGnexus (BackgroundTasks): roles background_task = external_endpoints roles = RoleSet { roles: {} }
113492024-12-12T22:44:26.203ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = external_endpoints resource = Database result = Ok(())
113502024-12-12T22:44:26.205ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113512024-12-12T22:44:26.205ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113522024-12-12T22:44:26.207ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113532024-12-12T22:44:26.207ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113542024-12-12T22:44:26.209ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113552024-12-12T22:44:26.209ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113562024-12-12T22:44:26.211ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113572024-12-12T22:44:26.215ZDEBGnexus (BackgroundTasks): found zones background_task = dns_config_internal count = 1 dns_group = internal
113582024-12-12T22:44:26.215ZDEBGnexus (BackgroundTasks): listing DNS names for zone background_task = dns_config_internal batch_size = 100 dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 0 version = 1
113592024-12-12T22:44:26.215ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113602024-12-12T22:44:26.215ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113612024-12-12T22:44:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ById(001de000-074c-4000-8000-000000000000) } result = Ok(())
113622024-12-12T22:44:26.216ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113632024-12-12T22:44:26.216ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113642024-12-12T22:44:26.217ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113652024-12-12T22:44:26.218ZDEBGnexus (BackgroundTasks): roles background_task = instance_reincarnation roles = RoleSet { roles: {} }
113662024-12-12T22:44:26.218ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_reincarnation resource = Database result = Ok(())
113672024-12-12T22:44:26.218ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113682024-12-12T22:44:26.219ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113692024-12-12T22:44:26.221ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = DnsConfig result = Ok(())
113702024-12-12T22:44:26.221ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_internal dns_group = internal roles = RoleSet { roles: {} }
113712024-12-12T22:44:26.222ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_internal dns_group = internal resource = Database result = Ok(())
113722024-12-12T22:44:26.224ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113732024-12-12T22:44:26.224ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 119.972676ms iteration = 21 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
113742024-12-12T22:44:26.224ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113752024-12-12T22:44:26.225ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_internal dns_group = internal dns_zone_id = de887878-a275-4b22-b4eb-f43805d2e995 dns_zone_name = control-plane.oxide.internal found_so_far = 51 version = 1
113762024-12-12T22:44:26.225ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_internal dns_group = internal nzones = 1 version = 1
113772024-12-12T22:44:26.225ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_internal current_generation = 1 current_time_created = 2024-12-12 22:34:37.342779 UTC dns_group = internal generation = 1
113782024-12-12T22:44:26.225ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_internal dns_group = internal elapsed = 120.613969ms iteration = 12 status = {"generation":1}
113792024-12-12T22:44:26.226ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113802024-12-12T22:44:26.226ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113812024-12-12T22:44:26.229ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113822024-12-12T22:44:26.230ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113832024-12-12T22:44:26.230ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113842024-12-12T22:44:26.231ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113852024-12-12T22:44:26.231ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113862024-12-12T22:44:26.232ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113872024-12-12T22:44:26.233ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113882024-12-12T22:44:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113892024-12-12T22:44:26.233ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
113902024-12-12T22:44:26.233ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
113912024-12-12T22:44:26.234ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113922024-12-12T22:44:26.235ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
113932024-12-12T22:44:26.238ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
113942024-12-12T22:44:26.238ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
113952024-12-12T22:44:26.238ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 133.483921ms iteration = 21 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
113962024-12-12T22:44:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
113972024-12-12T22:44:26.239ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
113982024-12-12T22:44:26.239ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
113992024-12-12T22:44:26.240ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
114002024-12-12T22:44:26.240ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114012024-12-12T22:44:26.240ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114022024-12-12T22:44:26.242ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114032024-12-12T22:44:26.242ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 137.538182ms iteration = 21 status = 0
114042024-12-12T22:44:26.242ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114052024-12-12T22:44:26.244ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114062024-12-12T22:44:26.244ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114072024-12-12T22:44:26.247ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114082024-12-12T22:44:26.248ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114092024-12-12T22:44:26.250ZDEBGnexus (BackgroundTasks): found Silo/DNS/TLS config (no change) background_task = external_endpoints config = ExternalEndpoints { by_dns_name: {"default-silo.sys.oxide.test": ExternalEndpoint { silo_id: 001de000-5110-4000-8000-000000000000, db_silo: Silo { identity: SiloIdentity { id: 001de000-5110-4000-8000-000000000000, name: Name(Name("default-silo")), description: "default silo", time_created: 2024-12-12T22:34:23.587536Z, time_modified: 2024-12-12T22:34:23.587536Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {}, rcgen: Generation(Generation(1)) }, tls_certs: [] }, "recovery.sys.oxide.test": ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }}, warnings: [NoSiloCerts { silo_id: 001de000-5110-4000-8000-000000000000, dns_name: "default-silo.sys.oxide.test" }], default_endpoint: Some(ExternalEndpoint { silo_id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, db_silo: Silo { identity: SiloIdentity { id: 207f2d86-9d5c-4ed8-9fa3-55f780829af6, name: Name(Name("recovery")), description: "built-in recovery Silo", time_created: 2024-12-12T22:34:38.101475Z, time_modified: 2024-12-12T22:34:38.101475Z, time_deleted: None }, discoverable: false, authentication_mode: Local, user_provision_type: ApiOnly, mapped_fleet_roles: Object {"admin": Array [String("admin")]}, rcgen: Generation(Generation(3)) }, tls_certs: [TlsCertificate { digest: "a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf" }] }) }
114102024-12-12T22:44:26.250ZDEBGnexus (BackgroundTasks): activation complete background_task = external_endpoints elapsed = 145.980987ms iteration = 12 status = {"by_dns_name":{"default-silo.sys.oxide.test":{"silo_id":"001de000-5110-4000-8000-000000000000","tls_certs":[]},"recovery.sys.oxide.test":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]}},"default_endpoint":{"silo_id":"207f2d86-9d5c-4ed8-9fa3-55f780829af6","tls_certs":["a96ab1177a60c1f57444dac9663aa9a8e90470de3cd144e4daa1e9851ce2aecf"]},"warnings":["silo 001de000-5110-4000-8000-000000000000 with DNS name \\"default-silo.sys.oxide.test\\" has no usable certificates"]}
114112024-12-12T22:44:26.252ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = DnsConfig result = Ok(())
114122024-12-12T22:44:26.252ZDEBGnexus (BackgroundTasks): roles background_task = dns_config_external dns_group = external roles = RoleSet { roles: {} }
114132024-12-12T22:44:26.253ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000001, lookup_type: ByName("external-dns") } result = Ok(())
114142024-12-12T22:44:26.253ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114152024-12-12T22:44:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = dns_config_external dns_group = external resource = Database result = Ok(())
114162024-12-12T22:44:26.253ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114172024-12-12T22:44:26.254ZDEBGnexus (BackgroundTasks): found all DNS names for zone background_task = dns_config_external dns_group = external dns_zone_id = 4860caf2-c749-4dc3-815c-729f732c1683 dns_zone_name = oxide.test found_so_far = 1 version = 2
114182024-12-12T22:44:26.254ZDEBGnexus (BackgroundTasks): read DNS config background_task = dns_config_external dns_group = external nzones = 1 version = 2
114192024-12-12T22:44:26.254ZDEBGnexus (BackgroundTasks): found latest DNS generation (unchanged) background_task = dns_config_external current_generation = 2 current_time_created = 2024-12-12 22:34:38.180496 UTC dns_group = external generation = 2
114202024-12-12T22:44:26.254ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_config_external dns_group = external elapsed = 149.70742ms iteration = 12 status = {"generation":2}
114212024-12-12T22:44:26.257ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114222024-12-12T22:44:26.257ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114232024-12-12T22:44:26.259ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114242024-12-12T22:44:26.259ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114252024-12-12T22:44:26.261ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114262024-12-12T22:44:26.261ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114272024-12-12T22:44:26.263ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114282024-12-12T22:44:26.264ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114292024-12-12T22:44:26.265ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114302024-12-12T22:44:26.266ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114312024-12-12T22:44:26.267ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114322024-12-12T22:44:26.267ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114332024-12-12T22:44:26.269ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114342024-12-12T22:44:26.269ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114352024-12-12T22:44:26.270ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114362024-12-12T22:44:26.272ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114372024-12-12T22:44:26.273ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114382024-12-12T22:44:26.274ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114392024-12-12T22:44:26.274ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114402024-12-12T22:44:26.274ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114412024-12-12T22:44:26.280ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114422024-12-12T22:44:26.280ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114432024-12-12T22:44:26.283ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114442024-12-12T22:44:26.284ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114452024-12-12T22:44:26.285ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114462024-12-12T22:44:26.289ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = VpcSubnet { parent: Vpc { parent: Project { parent: Silo { parent: Fleet, key: 001de000-5110-4000-8000-000000000001, lookup_type: ById(001de000-5110-4000-8000-000000000001) }, key: 001de000-4401-4000-8000-000000000000, lookup_type: ById(001de000-4401-4000-8000-000000000000) }, key: 001de000-074c-4000-8000-000000000000, lookup_type: ByName("oxide-services") }, key: 001de000-c470-4000-8000-000000000002, lookup_type: ByName("nexus") } result = Ok(())
114472024-12-12T22:44:26.289ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114482024-12-12T22:44:26.289ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114492024-12-12T22:44:26.297ZDEBGnexus (service-firewall-rule-progator): resolved names for firewall rules background_task = service_firewall_rule_propagation instance_interfaces = {} subnet_interfaces = {Name("nexus"): [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }], Name("external-dns"): [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }]} subnet_networks = {Name("nexus"): [V4(Ipv4Network { addr: 172.30.2.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:2::, prefix: 64 })], Name("external-dns"): [V4(Ipv4Network { addr: 172.30.1.0, prefix: 24 }), V6(Ipv6Network { addr: fd77:e9d2:9cd9:1::, prefix: 64 })]} vpc_interfaces = {}
114502024-12-12T22:44:26.297ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114512024-12-12T22:44:26.297ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114522024-12-12T22:44:26.298ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114532024-12-12T22:44:26.300ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Fleet result = Ok(())
114542024-12-12T22:44:26.300ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114552024-12-12T22:44:26.301ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114562024-12-12T22:44:26.303ZDEBGnexus (service-firewall-rule-progator): Allowlist for user-facing services is set to allow any inbound traffic. Existing VPC firewall rules will not be modified. background_task = service_firewall_rule_propagation
114572024-12-12T22:44:26.303ZDEBGnexus (service-firewall-rule-progator): resolved firewall rules for sled agents background_task = service_firewall_rule_propagation sled_agent_rules = [ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("53")]), filter_protocols: Some([Udp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 45cfa67e-332a-4cec-85d1-243e9f32a876, kind: Service { id: fccfaa8c-ea2a-4fac-967f-e43007ddb28d }, name: Name("external-dns-fccfaa8c-ea2a-4fac-967f-e43007ddb28d"), ip: 172.30.1.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 145, 178])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 69b76370-a65d-4204-8880-d58936824751, kind: Service { id: 6ed7f70e-6e55-43a0-a74c-b5cd82afb24a }, name: Name("external-dns-6ed7f70e-6e55-43a0-a74c-b5cd82afb24a"), ip: 172.30.1.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 151, 170])), subnet: V4(Ipv4Net { addr: 172.30.1.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }, ResolvedVpcFirewallRule { action: Allow, direction: Inbound, filter_hosts: None, filter_ports: Some([L4PortRange("80"), L4PortRange("443")]), filter_protocols: Some([Tcp]), priority: 65534, status: Enabled, targets: [NetworkInterface { id: 1f434862-7361-4e97-9d56-f7543a4e5095, kind: Service { id: d54db0af-3f39-4565-8dff-ec97c7805e6f }, name: Name("nexus-d54db0af-3f39-4565-8dff-ec97c7805e6f"), ip: 172.30.2.5, mac: MacAddr(MacAddr6([168, 64, 37, 255, 142, 83])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: 5b8cff61-decc-4463-9658-2d8a426b498f, kind: Service { id: 736f44c0-88a6-4603-9cb4-5b66735cd20b }, name: Name("nexus-736f44c0-88a6-4603-9cb4-5b66735cd20b"), ip: 172.30.2.7, mac: MacAddr(MacAddr6([168, 64, 37, 255, 233, 96])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }, NetworkInterface { id: cf9e8f2a-0234-47bf-b1d5-dd2f6dd3bf25, kind: Service { id: fdc353cb-29c5-4cf1-8399-519a1c345142 }, name: Name("nexus-fdc353cb-29c5-4cf1-8399-519a1c345142"), ip: 172.30.2.6, mac: MacAddr(MacAddr6([168, 64, 37, 255, 164, 173])), subnet: V4(Ipv4Net { addr: 172.30.2.0, width: 24 }), vni: Vni(100), primary: true, slot: 0, transit_ips: [] }] }]
114582024-12-12T22:44:26.303ZDEBGnexus (service-firewall-rule-progator): resolved 2 rules for sleds background_task = service_firewall_rule_propagation
114592024-12-12T22:44:26.305ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114602024-12-12T22:44:26.305ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114612024-12-12T22:44:26.306ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "efe4b621-4d20-4b04-a014-86a6f7ea7f01", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
114622024-12-12T22:44:26.306ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114632024-12-12T22:44:26.308ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114642024-12-12T22:44:26.322ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 217.863739ms iteration = 23 status = {"physical_disks_added":0}
114652024-12-12T22:44:26.332ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
114662024-12-12T22:44:26.332ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114672024-12-12T22:44:26.332ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d88f82e3-ef49-45d1-9fd4-06f5090fd955", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
114682024-12-12T22:44:26.332ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114692024-12-12T22:44:26.333ZWARNnexus (BackgroundTasks): instance reincarnation completed with errors background_task = instance_reincarnation file = nexus/src/app/background/tasks/instance_reincarnation.rs:103 instances_changed_state = 0 instances_found = 0 instances_reincarnated = 0 query_errors = 0 restart_errors = 0
114702024-12-12T22:44:26.333ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_reincarnation elapsed = 228.004438ms iteration = 11 status = {"changed_state":[],"disabled":false,"errors":[],"instances_found":{"Failed":0,"SagaUnwound":0},"instances_reincarnated":[],"restart_errors":[]}
114712024-12-12T22:44:26.334ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
114722024-12-12T22:44:26.340ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
114732024-12-12T22:44:26.340ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
114742024-12-12T22:44:26.340ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "5ce5adce-e3e4-4129-a306-ba3b6f1ad03c", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
114752024-12-12T22:44:26.340ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
114762024-12-12T22:44:26.342ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
114772024-12-12T22:44:26.395ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114782024-12-12T22:44:26.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114792024-12-12T22:44:26.397ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114802024-12-12T22:44:26.399ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114812024-12-12T22:44:26.399ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114822024-12-12T22:44:26.399ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114832024-12-12T22:44:26.401ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
114842024-12-12T22:44:26.403ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
114852024-12-12T22:44:26.403ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
114862024-12-12T22:44:26.403ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
114872024-12-12T22:44:26.453ZDEBGnexus (service-firewall-rule-progator): resolved sleds for vpc oxide-services background_task = service_firewall_rule_propagation vpc_to_sled = [Sled { identity: SledIdentity { id: 4a8c9490-d35a-4221-8585-e4103b325118, time_created: 2024-12-12T22:34:36.929491Z, time_modified: 2024-12-12T22:34:36.929491Z }, time_deleted: None, rcgen: Generation(Generation(19)), rack_id: ceaea472-35b2-490f-a91b-ab350691945c, is_scrimlet: true, serial_number: "sock", part_number: "i86pc", revision: SqlU32(0), usable_hardware_threads: SqlU32(48), usable_physical_ram: ByteCount(ByteCount(102952026112)), reservoir_size: ByteCount(ByteCount(51474595840)), ip: fd00:1122:3344:101::1, port: SqlU16(12345), last_used_address: fd00:1122:3344:101::ffff, policy: InService, state: Active, sled_agent_gen: Generation(Generation(1)) }]
114882024-12-12T22:44:26.453ZDEBGnexus (service-firewall-rule-progator): sending firewall rules to sled agents background_task = service_firewall_rule_propagation
114892024-12-12T22:44:26.453ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
114902024-12-12T22:44:26.454ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
114912024-12-12T22:44:26.488ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:1::1]:5353/config
114922024-12-12T22:44:26.511ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::9]:5353/config
114932024-12-12T22:44:26.571ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
114942024-12-12T22:44:26.572ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "164490d6-00c4-4fbf-a0cb-25f14728e289", "content-length": "1", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
114952024-12-12T22:44:26.573ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
114962024-12-12T22:44:26.573ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
114972024-12-12T22:44:26.596ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
114982024-12-12T22:44:26.596ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
114992024-12-12T22:44:26.596ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "2f09b19c-df0f-48ca-a729-40a42db09475", "content-length": "372", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
115002024-12-12T22:44:26.596ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115012024-12-12T22:44:26.597ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115022024-12-12T22:44:26.599ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {} }
115032024-12-12T22:44:26.599ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Database result = Ok(())
115042024-12-12T22:44:26.599ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 494.804198ms iteration = 21 status = null
115052024-12-12T22:44:26.601ZDEBGnexus (BackgroundTasks): roles background_task = service_firewall_rule_propagation roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115062024-12-12T22:44:26.604ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_firewall_rule_propagation resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
115072024-12-12T22:44:26.614ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
115082024-12-12T22:44:26.614ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
115092024-12-12T22:44:26.614ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "56139c45-b95e-4bef-902e-ee511dd32a3e", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
115102024-12-12T22:44:26.614ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115112024-12-12T22:44:26.614ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115122024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): begin collection background_task = inventory_collection
115132024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): begin collection from MGS background_task = inventory_collection mgs_url = http://[fd00:1122:3344:101::2]:12225
115142024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/ignition
115152024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/ignition", status: 200, headers: {"content-type": "application/json", "x-request-id": "17fbd97e-405d-43e9-b642-1c9e3316c684", "content-length": "476", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115162024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0
115172024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "f6b409ea-202c-454f-bec2-e67edc6a52ab", "content-length": "734", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115182024-12-12T22:44:26.626ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0
115192024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "e642587a-dadb-4422-908c-b9c252e26247", "content-length": "111", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115202024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1
115212024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "b097bfa8-9961-48a4-b8f0-e34e1cb0a181", "content-length": "111", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115222024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0
115232024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "beef227e-d586-461b-a408-fe79e79103bf", "content-length": "167", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115242024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1
115252024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "3712533f-079d-4209-bfbe-97ee1f402681", "content-length": "167", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115262024-12-12T22:44:26.627ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0
115272024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "fb552125-773b-4175-bf44-2e48e6899498", "content-length": "175", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115282024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1
115292024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "420ef81f-fb54-461e-b871-983ccc642347", "content-length": "175", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115302024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa
115312024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "90bb9c85-0b20-4ebc-86a9-92d51f6fc6d7", "content-length": "702", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115322024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
115332024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1b033b3b-f7fe-44d6-8444-f214567912f7", "content-length": "727", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115342024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
115352024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "fdc9c0ba-9e47-49b6-bdd3-78f9461339b2", "content-length": "729", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115362024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa
115372024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/switch/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "df8ff0c6-4b90-473a-bb31-fb22d25d32df", "content-length": "728", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115382024-12-12T22:44:26.628ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0
115392024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0", status: 200, headers: {"content-type": "application/json", "x-request-id": "86e97334-7ab7-46c9-9f2a-8086a347a5fe", "content-length": "722", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115402024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0
115412024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "0a93808d-3bc8-465a-ba57-cde28e0df155", "content-length": "109", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115422024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1
115432024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/sp/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "ebda0433-3889-4284-bf14-9d03b1ce4c45", "content-length": "109", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115442024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0
115452024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "041b10f8-fd63-4fec-8a11-b65a0e3cb374", "content-length": "169", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115462024-12-12T22:44:26.629ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1
115472024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "97b3b787-db24-4f9f-b5f9-744674210898", "content-length": "169", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115482024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0
115492024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=0", status: 200, headers: {"content-type": "application/json", "x-request-id": "eecb2093-0802-4fba-af7a-0d93d66291fc", "content-length": "178", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115502024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1
115512024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/stage0/caboose?firmware_slot=1", status: 200, headers: {"content-type": "application/json", "x-request-id": "aab32730-aee0-4405-b1d4-8b42e59099de", "content-length": "178", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115522024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = None gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa
115532024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cmpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "f9aa5ace-64b0-45be-bbe4-12d8ca13167d", "content-length": "702", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115542024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115552024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "8cc61109-03da-4c59-929a-6b505a6bce58", "content-length": "727", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115562024-12-12T22:44:26.630ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115572024-12-12T22:44:26.631ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "1d562bfe-d9b7-4f54-9b51-8aa44d52b3c5", "content-length": "729", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115582024-12-12T22:44:26.631ZDEBGnexus (BackgroundTasks): client request background_task = inventory_collection body = Some(Body) gateway_url = http://[fd00:1122:3344:101::2]:12225 method = GET uri = http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa
115592024-12-12T22:44:26.631ZDEBGnexus (BackgroundTasks): client response background_task = inventory_collection gateway_url = http://[fd00:1122:3344:101::2]:12225 result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/sp/sled/0/component/rot/cfpa", status: 200, headers: {"content-type": "application/json", "x-request-id": "ddd27bd1-73ad-4bc8-be1d-ad808bfd9b58", "content-length": "728", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
115602024-12-12T22:44:26.631ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115612024-12-12T22:44:26.631ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115622024-12-12T22:44:26.686ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 581.780786ms iteration = 21 status = {}
115632024-12-12T22:44:26.779ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
115642024-12-12T22:44:26.780ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "548f3947-8bfa-4fc4-94d7-a6f79c983be2", "content-length": "691", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
115652024-12-12T22:44:26.780ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
115662024-12-12T22:44:26.780ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
115672024-12-12T22:44:26.780ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
115682024-12-12T22:44:26.780ZDEBGnexus (service-firewall-rule-progator): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = service_firewall_rule_propagation body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules
115692024-12-12T22:44:26.781ZDEBGnexus (service-firewall-rule-progator): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = service_firewall_rule_propagation result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc/001de000-074c-4000-8000-000000000000/firewall/rules", status: 204, headers: {"x-request-id": "5ec5bc4b-f192-4db6-b5cc-53ee73f00445", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
115702024-12-12T22:44:26.781ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 676.377925ms iteration = 21 status = {}
115712024-12-12T22:44:26.782ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115722024-12-12T22:44:26.782ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115732024-12-12T22:44:26.782ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115742024-12-12T22:44:26.783ZINFOnexus (service-firewall-rule-progator): updated firewall rules on 1 sleds background_task = service_firewall_rule_propagation file = nexus/networking/src/firewall_rules.rs:496
115752024-12-12T22:44:26.783ZDEBGnexus (service-firewall-rule-progator): successfully propagated service firewall rules background_task = service_firewall_rule_propagation elapsed = 678.958934ms
115762024-12-12T22:44:26.783ZDEBGnexus (BackgroundTasks): activation complete background_task = service_firewall_rule_propagation elapsed = 678.969865ms iteration = 3 status = {}
115772024-12-12T22:44:26.784ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115782024-12-12T22:44:26.784ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115792024-12-12T22:44:26.784ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115802024-12-12T22:44:26.784ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
115812024-12-12T22:44:26.785ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
115822024-12-12T22:44:26.785ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
115832024-12-12T22:44:26.787ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Fleet result = Ok(())
115842024-12-12T22:44:26.787ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
115852024-12-12T22:44:26.788ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
115862024-12-12T22:44:26.789ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
115872024-12-12T22:44:26.789ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
115882024-12-12T22:44:26.789ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ffac5b7f-f632-4285-bb09-5109926354ff", "date": "Thu, 12 Dec 2024 22:44:25 GMT"} })
115892024-12-12T22:44:26.791ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 686.562324ms iteration = 22 status = {}
115902024-12-12T22:44:26.822ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:3::1]:5353/config
115912024-12-12T22:44:26.841ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_external body = Some(Body) dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] } uri = http://[fd00:1122:3344:101::8]:5353/config
115922024-12-12T22:44:26.842ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::8]:5353/config", status: 204, headers: {"x-request-id": "d444c37f-5b95-4bee-8e79-c1c34de9a741", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115932024-12-12T22:44:26.842ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::8]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115942024-12-12T22:44:26.843ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 generation = 2 result = Ok(Response { url: "http://[fd00:1122:3344:101::9]:5353/config", status: 204, headers: {"x-request-id": "7f3fe430-03d3-416a-8c03-30200ae9b5ed", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115952024-12-12T22:44:26.843ZINFOnexus (BackgroundTasks): DNS server now at generation 2 background_task = dns_propagation_external dns_group = external dns_server_url = http://[fd00:1122:3344:101::9]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115962024-12-12T22:44:26.845ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_external dns_group = external file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 2 servers = DnsServersList { addresses: [[fd00:1122:3344:101::9]:5353, [fd00:1122:3344:101::8]:5353] }
115972024-12-12T22:44:26.845ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_external dns_group = external elapsed = 740.30604ms iteration = 13 status = {"generation":2,"server_results":{"[fd00:1122:3344:101::8]:5353":{"Ok":null},"[fd00:1122:3344:101::9]:5353":{"Ok":null}}}
115982024-12-12T22:44:26.859ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
115992024-12-12T22:44:26.859ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116002024-12-12T22:44:26.861ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
116012024-12-12T22:44:26.861ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116022024-12-12T22:44:26.861ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116032024-12-12T22:44:26.871ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
116042024-12-12T22:44:26.871ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "2971b54e-dc34-4c7c-aeee-2359a04cde0d", "content-length": "134", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116052024-12-12T22:44:26.871ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
116062024-12-12T22:44:26.871ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
116072024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
116082024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
116092024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116102024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116112024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116122024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116132024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
116142024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
116152024-12-12T22:44:26.872ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
116162024-12-12T22:44:26.872ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116172024-12-12T22:44:26.872ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116182024-12-12T22:44:26.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
116192024-12-12T22:44:26.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "77e54aa8-b8bf-410b-8c25-927bb4ce286d", "content-length": "2", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116202024-12-12T22:44:26.874ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
116212024-12-12T22:44:26.874ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "ee0b29fd-cfa2-4f1d-84ce-10bb54356a66", "content-length": "52", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116222024-12-12T22:44:26.874ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
116232024-12-12T22:44:26.874ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
116242024-12-12T22:44:26.877ZDEBGnexus (BackgroundTasks): begin collection from Sled Agent background_task = inventory_collection sled_agent_url = http://[fd00:1122:3344:101::1]:12345
116252024-12-12T22:44:26.877ZDEBGnexus (BackgroundTasks): client request SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/inventory
116262024-12-12T22:44:26.891ZDEBGnexus (BackgroundTasks): client request background_task = dns_propagation_internal body = Some(Body) dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 method = PUT servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] } uri = http://[fd00:1122:3344:2::1]:5353/config
116272024-12-12T22:44:26.891ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:2::1]:5353/config", status: 204, headers: {"x-request-id": "34de3d81-01fd-4a2d-a92f-0e281355b2ee", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116282024-12-12T22:44:26.891ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:2::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116292024-12-12T22:44:26.892ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:3::1]:5353/config", status: 204, headers: {"x-request-id": "dc5bd2fe-fdb0-4dc9-ac2f-4faa9e16357e", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116302024-12-12T22:44:26.892ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:3::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116312024-12-12T22:44:26.893ZDEBGnexus (BackgroundTasks): client response background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 generation = 1 result = Ok(Response { url: "http://[fd00:1122:3344:1::1]:5353/config", status: 204, headers: {"x-request-id": "3ab50ca7-1504-47d5-8fb3-de0190d3cd87", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} }) servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116322024-12-12T22:44:26.893ZINFOnexus (BackgroundTasks): DNS server now at generation 1 background_task = dns_propagation_internal dns_group = internal dns_server_url = http://[fd00:1122:3344:1::1]:5353 file = nexus/src/app/background/tasks/dns_propagation.rs:169 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116332024-12-12T22:44:26.895ZINFOnexus (BackgroundTasks): DNS propagation: done background_task = dns_propagation_internal dns_group = internal file = nexus/src/app/background/tasks/dns_propagation.rs:106 generation = 1 servers = DnsServersList { addresses: [[fd00:1122:3344:1::1]:5353, [fd00:1122:3344:3::1]:5353, [fd00:1122:3344:2::1]:5353] }
116342024-12-12T22:44:26.895ZDEBGnexus (BackgroundTasks): activation complete background_task = dns_propagation_internal dns_group = internal elapsed = 790.859982ms iteration = 13 status = {"generation":1,"server_results":{"[fd00:1122:3344:1::1]:5353":{"Ok":null},"[fd00:1122:3344:2::1]:5353":{"Ok":null},"[fd00:1122:3344:3::1]:5353":{"Ok":null}}}
116352024-12-12T22:44:26.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "fd787b45-1aab-4d2a-ba6c-f0b8a5899900", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116362024-12-12T22:44:26.973ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
116372024-12-12T22:44:26.973ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
116382024-12-12T22:44:26.973ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "235511dd-dbb9-466e-8d54-48965bf144d6", "content-length": "682", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116392024-12-12T22:44:26.973ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116402024-12-12T22:44:26.974ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116412024-12-12T22:44:26.977ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116422024-12-12T22:44:26.977ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116432024-12-12T22:44:26.980ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116442024-12-12T22:44:26.981ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116452024-12-12T22:44:26.983ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
116462024-12-12T22:44:26.983ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
116472024-12-12T22:44:26.990ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 885.729886ms iteration = 21 status = {}
116482024-12-12T22:44:27.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1025 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = ef4f4af9-0d2a-4dcf-9842-9ceb718b5133 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
116492024-12-12T22:44:27.189ZDEBGnexus (BackgroundTasks): client response SledAgent = http://[fd00:1122:3344:101::1]:12345 background_task = inventory_collection result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/inventory", status: 200, headers: {"content-type": "application/json", "x-request-id": "8d6bed71-c4c6-47df-a308-cd4d58854cb4", "content-length": "30426", "date": "Thu, 12 Dec 2024 22:44:26 GMT"} })
116502024-12-12T22:44:27.191ZDEBGnexus (BackgroundTasks): begin collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116512024-12-12T22:44:27.191ZDEBGnexus (BackgroundTasks): end collecting all keepers background_task = inventory_collection nkeeper_admin_clients = 0
116522024-12-12T22:44:27.191ZDEBGnexus (BackgroundTasks): finished collection background_task = inventory_collection
116532024-12-12T22:44:27.193ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116542024-12-12T22:44:27.193ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116552024-12-12T22:44:27.195ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116562024-12-12T22:44:27.197ZDEBGnexus (BackgroundTasks): authorize result action = Modify actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Inventory result = Ok(())
116572024-12-12T22:44:27.197ZDEBGnexus (BackgroundTasks): roles background_task = inventory_collection roles = RoleSet { roles: {} }
116582024-12-12T22:44:27.197ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = inventory_collection resource = Database result = Ok(())
116592024-12-12T22:44:27.350ZINFOnexus (BackgroundTasks): inserted inventory collection background_task = inventory_collection collection_id = 06e5b644-3056-4b75-83c0-6f78018c513d file = nexus/db-queries/src/db/datastore/inventory.rs:1010
116602024-12-12T22:44:27.350ZDEBGnexus (BackgroundTasks): inventory collection complete background_task = inventory_collection collection_id = 06e5b644-3056-4b75-83c0-6f78018c513d time_started = 2024-12-12 22:44:26.626286 UTC
116612024-12-12T22:44:27.350ZDEBGnexus (BackgroundTasks): activation complete background_task = inventory_collection elapsed = 1.245218575s iteration = 3 status = {"collection_id":"06e5b644-3056-4b75-83c0-6f78018c513d","time_done":"2024-12-12 22:44:27.191579 UTC","time_started":"2024-12-12 22:44:26.626286 UTC"}
116622024-12-12T22:44:27.350ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 24 reason = Dependency
116632024-12-12T22:44:27.350ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116642024-12-12T22:44:27.350ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116652024-12-12T22:44:27.352ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116662024-12-12T22:44:27.354ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116672024-12-12T22:44:27.354ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116682024-12-12T22:44:27.354ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116692024-12-12T22:44:27.356ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116702024-12-12T22:44:27.356ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116712024-12-12T22:44:27.358ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116722024-12-12T22:44:27.360ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
116732024-12-12T22:44:27.360ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
116742024-12-12T22:44:27.360ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
116752024-12-12T22:44:27.397ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 47.243818ms iteration = 24 status = {"physical_disks_added":0}
116762024-12-12T22:44:33.658ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::2]:34380
116772024-12-12T22:44:33.658ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34380 req_id = 8df39eaf-25dd-42f4-b4c5-9c46e0c120b1 roles = RoleSet { roles: {} } uri = /metrics/producers
116782024-12-12T22:44:33.658ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34380 req_id = 8df39eaf-25dd-42f4-b4c5-9c46e0c120b1 resource = Database result = Ok(()) uri = /metrics/producers
116792024-12-12T22:44:33.694ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = bb9dca28-dea1-4105-b015-9af4a5ccce7e
116802024-12-12T22:44:33.694ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 36320 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::2]:34380 req_id = 8df39eaf-25dd-42f4-b4c5-9c46e0c120b1 response_code = 201 uri = /metrics/producers
116812024-12-12T22:44:36.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 62 reason = Timeout
116822024-12-12T22:44:36.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 62 reason = Timeout
116832024-12-12T22:44:36.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116842024-12-12T22:44:36.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116852024-12-12T22:44:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116862024-12-12T22:44:36.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116872024-12-12T22:44:36.106ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
116882024-12-12T22:44:36.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
116892024-12-12T22:44:36.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116902024-12-12T22:44:36.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 4.364085ms iteration = 62 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
116912024-12-12T22:44:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
116922024-12-12T22:44:36.110ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116932024-12-12T22:44:36.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116942024-12-12T22:44:36.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116952024-12-12T22:44:36.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
116962024-12-12T22:44:36.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
116972024-12-12T22:44:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
116982024-12-12T22:44:36.116ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
116992024-12-12T22:44:36.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117002024-12-12T22:44:36.125ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
117012024-12-12T22:44:36.125ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 20.804878ms iteration = 62 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
117022024-12-12T22:44:37.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1053 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 9bd45d69-56ea-4678-85b8-29b2284bb500 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
117032024-12-12T22:44:39.870ZDEBGnexus (producer-registration-task): registering / renewing oximeter producer lease with Nexus
117042024-12-12T22:44:39.870ZDEBGnexus (producer-registration-task): using nexus address for registration addr = [fd00:1122:3344:101::c]:12221
117052024-12-12T22:44:39.901ZDEBGnexus (producer-registration-task): client request body = Some(Body) method = POST uri = http://[fd00:1122:3344:101::c]:12221/metrics/producers
117062024-12-12T22:44:39.901ZINFOnexus (dropshot_internal): accepted connection file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:1023 local_addr = [fd00:1122:3344:101::c]:12221 remote_addr = [fd00:1122:3344:101::c]:39422
117072024-12-12T22:44:39.901ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39422 req_id = e01bbc1c-affe-4144-b1a5-46755089eee0 roles = RoleSet { roles: {} } uri = /metrics/producers
117082024-12-12T22:44:39.901ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39422 req_id = e01bbc1c-affe-4144-b1a5-46755089eee0 resource = Database result = Ok(()) uri = /metrics/producers
117092024-12-12T22:44:39.934ZINFOnexus: assigned collector to new producer collector_id = 87a16640-e63a-4805-af37-109a4b725900 file = nexus/src/app/oximeter.rs:76 producer_id = 736f44c0-88a6-4603-9cb4-5b66735cd20b
117102024-12-12T22:44:39.934ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 32802 local_addr = [fd00:1122:3344:101::c]:12221 method = POST remote_addr = [fd00:1122:3344:101::c]:39422 req_id = e01bbc1c-affe-4144-b1a5-46755089eee0 response_code = 201 uri = /metrics/producers
117112024-12-12T22:44:39.934ZDEBGnexus (producer-registration-task): client response result = Ok(Response { url: "http://[fd00:1122:3344:101::c]:12221/metrics/producers", status: 201, headers: {"content-type": "application/json", "x-request-id": "e01bbc1c-affe-4144-b1a5-46755089eee0", "content-length": "41", "date": "Thu, 12 Dec 2024 22:44:39 GMT"} })
117122024-12-12T22:44:39.935ZDEBGnexus (producer-registration-task): registered with nexus successfully
117132024-12-12T22:44:39.935ZDEBGnexus (producer-registration-task): pausing until time to renew lease lease_duration = 600s wait_period = 150s
117142024-12-12T22:44:46.104ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 63 reason = Timeout
117152024-12-12T22:44:46.104ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117162024-12-12T22:44:46.104ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 63 reason = Timeout
117172024-12-12T22:44:46.104ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117182024-12-12T22:44:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117192024-12-12T22:44:46.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117202024-12-12T22:44:46.107ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117212024-12-12T22:44:46.107ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117222024-12-12T22:44:46.107ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117232024-12-12T22:44:46.108ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 3.944427ms iteration = 63 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
117242024-12-12T22:44:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
117252024-12-12T22:44:46.109ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117262024-12-12T22:44:46.109ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117272024-12-12T22:44:46.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117282024-12-12T22:44:46.112ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117292024-12-12T22:44:46.113ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117302024-12-12T22:44:46.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
117312024-12-12T22:44:46.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117322024-12-12T22:44:46.116ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117332024-12-12T22:44:46.127ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
117342024-12-12T22:44:46.127ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 22.770147ms iteration = 63 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
117352024-12-12T22:44:47.179ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3fae8d99-98b4-4dde-87d5-19d2ebaf5fe4 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
117362024-12-12T22:44:47.179ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3fae8d99-98b4-4dde-87d5-19d2ebaf5fe4 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
117372024-12-12T22:44:47.181ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2207 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 3fae8d99-98b4-4dde-87d5-19d2ebaf5fe4 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?sort_by=id_ascending
117382024-12-12T22:44:47.182ZDEBGnexus (dropshot_internal): roles actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 749da0c5-e3f1-4826-9a73-7685f11f3491 roles = RoleSet { roles: {} } uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
117392024-12-12T22:44:47.182ZDEBGnexus (dropshot_internal): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) actor_id = 001de000-05e4-4000-8000-000000000002 authenticated = true local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 749da0c5-e3f1-4826-9a73-7685f11f3491 resource = Database result = Ok(()) uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
117402024-12-12T22:44:47.184ZINFOnexus (dropshot_internal): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 2266 local_addr = [fd00:1122:3344:101::c]:12221 method = GET remote_addr = [fd00:1122:3344:101::d]:42653 req_id = 749da0c5-e3f1-4826-9a73-7685f11f3491 response_code = 200 uri = /metrics/collectors/87a16640-e63a-4805-af37-109a4b725900/producers?page_token=eyJ2IjoidjEiLCJwYWdlX3N0YXJ0Ijp7InNvcnRfYnkiOiJpZF9hc2NlbmRpbmciLCJsYXN0X3NlZW4iOiJmZGMzNTNjYi0yOWM1LTRjZjEtODM5OS01MTlhMWMzNDUxNDIifX0%3D
117412024-12-12T22:44:47.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1208 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = 3c8cabd2-fc72-4cfb-b3bc-aac3a8025e25 response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b
117422024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = switch_port_config_manager iteration = 22 reason = Timeout
117432024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
117442024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement iteration = 22 reason = Timeout
117452024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_replacement_driver iteration = 64 reason = Timeout
117462024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
117472024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117482024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = blueprint_loader iteration = 64 reason = Timeout
117492024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = physical_disk_adoption iteration = 25 reason = Timeout
117502024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
117512024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
117522024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = v2p_manager iteration = 22 reason = Timeout
117532024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
117542024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = service_zone_nat_tracker iteration = 22 reason = Timeout
117552024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = phantom_disks iteration = 22 reason = Timeout
117562024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
117572024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_updater iteration = 22 reason = Timeout
117582024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): looking for instances with destroyed active VMMs... background_task = instance_updater
117592024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
117602024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = instance_watcher iteration = 22 reason = Timeout
117612024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = nat_v4_garbage_collector iteration = 22 reason = Timeout
117622024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
117632024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = vpc_route_manager iteration = 23 reason = Timeout
117642024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
117652024-12-12T22:44:56.105ZINFOnexus (BackgroundTasks): VPC route manager running background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:60
117662024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = bfd_manager iteration = 22 reason = Timeout
117672024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
117682024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = bfd_manager roles = RoleSet { roles: {} }
117692024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_start iteration = 22 reason = Timeout
117702024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
117712024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_garbage_collection iteration = 22 reason = Timeout
117722024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_garbage_collection roles = RoleSet { roles: {} }
117732024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_finish iteration = 22 reason = Timeout
117742024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_finish roles = RoleSet { roles: {} }
117752024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): activating background_task = region_snapshot_replacement_step iteration = 22 reason = Timeout
117762024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
117772024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
117782024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
117792024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117802024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
117812024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
117822024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
117832024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
117842024-12-12T22:44:56.105ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
117852024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_garbage_collection resource = Database result = Ok(())
117862024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
117872024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = bfd_manager resource = Database result = Ok(())
117882024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
117892024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
117902024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
117912024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_finish resource = Database result = Ok(())
117922024-12-12T22:44:56.106ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
117932024-12-12T22:44:56.107ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117942024-12-12T22:44:56.108ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement_driver roles = RoleSet { roles: {} }
117952024-12-12T22:44:56.108ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement_driver resource = Database result = Ok(())
117962024-12-12T22:44:56.108ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
117972024-12-12T22:44:56.108ZDEBGnexus (BackgroundTasks): activation complete background_task = phantom_disks elapsed = 3.352145ms iteration = 22 status = {"phantom_disk_deleted_err":0,"phantom_disk_deleted_ok":0}
117982024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Fleet result = Ok(())
117992024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
118002024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
118012024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118022024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118032024-12-12T22:44:56.110ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118042024-12-12T22:44:56.111ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118052024-12-12T22:44:56.113ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4027, tv_nsec: 35640002 } })
118062024-12-12T22:44:56.114ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1103
118072024-12-12T22:44:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = BlueprintConfig result = Ok(())
118082024-12-12T22:44:56.115ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118092024-12-12T22:44:56.115ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118102024-12-12T22:44:56.119ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118112024-12-12T22:44:56.120ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4027, tv_nsec: 42433005 } })
118122024-12-12T22:44:56.120ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Fleet result = Ok(())
118132024-12-12T22:44:56.120ZDEBGnexus (BackgroundTasks): roles background_task = instance_watcher roles = RoleSet { roles: {} }
118142024-12-12T22:44:56.120ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_watcher resource = Database result = Ok(())
118152024-12-12T22:44:56.120ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118162024-12-12T22:44:56.120ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = bfd_manager file = nexus/src/app/mod.rs:1103
118172024-12-12T22:44:56.122ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118182024-12-12T22:44:56.122ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118192024-12-12T22:44:56.123ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118202024-12-12T22:44:56.124ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement_driver elapsed = 18.80162ms iteration = 64 status = {"drive_invoked_ok":[],"errors":[],"finish_invoked_ok":[]}
118212024-12-12T22:44:56.125ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118222024-12-12T22:44:56.125ZDEBGnexus (DnsResolver): lookup_all_ipv6 srv dns_name = _dendrite._tcp.control-plane.oxide.internal response = SrvLookup(Lookup { query: Query { name: Name("_dendrite._tcp.control-plane.oxide.internal"), query_type: SRV, query_class: IN }, records: [Record { name_labels: Name("_dendrite._tcp.control-plane.oxide.internal."), rr_type: SRV, dns_class: IN, ttl: 0, rdata: Some(SRV(SRV { priority: 0, weight: 0, port: 12224, target: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal.") })) }, Record { name_labels: Name("dendrite-4a8c9490-d35a-4221-8585-e4103b325118.host.control-plane.oxide.internal."), rr_type: AAAA, dns_class: IN, ttl: 0, rdata: Some(AAAA(AAAA(fd00:1122:3344:101::2))) }], valid_until: Instant { tv_sec: 4027, tv_nsec: 47261470 } })
118232024-12-12T22:44:56.125ZINFOnexus (BackgroundTasks): Determining switch slots managed by switch zones background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1103 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
118242024-12-12T22:44:56.125ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118252024-12-12T22:44:56.126ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118262024-12-12T22:44:56.126ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_finish elapsed = 20.708257ms iteration = 22 status = {"errors":[],"records_set_to_done":[]}
118272024-12-12T22:44:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118282024-12-12T22:44:56.126ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118292024-12-12T22:44:56.128ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118302024-12-12T22:44:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Inventory result = Ok(())
118312024-12-12T22:44:56.129ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118322024-12-12T22:44:56.129ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118332024-12-12T22:44:56.129ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
118342024-12-12T22:44:56.129ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118352024-12-12T22:44:56.132ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Fleet result = Ok(())
118362024-12-12T22:44:56.132ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
118372024-12-12T22:44:56.132ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
118382024-12-12T22:44:56.133ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Fleet result = Ok(())
118392024-12-12T22:44:56.133ZDEBGnexus (BackgroundTasks): roles background_task = physical_disk_adoption roles = RoleSet { roles: {} }
118402024-12-12T22:44:56.133ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = physical_disk_adoption resource = Database result = Ok(())
118412024-12-12T22:44:56.134ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Blueprint { parent: Fleet, key: 9340586b-e531-4e39-8dbf-b547c38f365c, lookup_type: ById(9340586b-e531-4e39-8dbf-b547c38f365c) } result = Ok(())
118422024-12-12T22:44:56.134ZDEBGnexus (BackgroundTasks): roles background_task = blueprint_loader roles = RoleSet { roles: {} }
118432024-12-12T22:44:56.134ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = blueprint_loader resource = Database result = Ok(())
118442024-12-12T22:44:56.135ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118452024-12-12T22:44:56.135ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118462024-12-12T22:44:56.144ZDEBGnexus (BackgroundTasks): activation complete background_task = physical_disk_adoption elapsed = 39.588418ms iteration = 25 status = {"physical_disks_added":0}
118472024-12-12T22:44:56.148ZDEBGnexus (BackgroundTasks): found latest target blueprint (unchanged) background_task = blueprint_loader original_target_id = 9340586b-e531-4e39-8dbf-b547c38f365c original_time_created = 2024-12-12 22:34:19.472264 UTC target_id = 9340586b-e531-4e39-8dbf-b547c38f365c time_created = 2024-12-12 22:34:19.472264 UTC
118482024-12-12T22:44:56.148ZDEBGnexus (BackgroundTasks): activation complete background_task = blueprint_loader elapsed = 42.711629ms iteration = 64 status = {"enabled":false,"status":"target blueprint unchanged","target_id":"9340586b-e531-4e39-8dbf-b547c38f365c","time_created":"2024-12-12T22:34:19.472264Z"}
118492024-12-12T22:44:56.153ZDEBGnexus (BackgroundTasks): roles background_task = region_replacement roles = RoleSet { roles: {} }
118502024-12-12T22:44:56.154ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_replacement resource = Database result = Ok(())
118512024-12-12T22:44:56.154ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118522024-12-12T22:44:56.155ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118532024-12-12T22:44:56.157ZINFOnexus (BackgroundTasks): listed instances with destroyed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118542024-12-12T22:44:56.157ZDEBGnexus (BackgroundTasks): looking for instances with failed active VMMs... background_task = instance_updater
118552024-12-12T22:44:56.157ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118562024-12-12T22:44:56.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118572024-12-12T22:44:56.157ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118582024-12-12T22:44:56.157ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118592024-12-12T22:44:56.159ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_start roles = RoleSet { roles: {} }
118602024-12-12T22:44:56.159ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_start resource = Database result = Ok(())
118612024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_garbage_collection elapsed = 54.580662ms iteration = 22 status = {"errors":[],"garbage_collect_requested":[]}
118622024-12-12T22:44:56.160ZINFOnexus (BackgroundTasks): listed instances with failed active VMMs background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118632024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): looking for instances with terminated active migrations... background_task = instance_updater
118642024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): roles background_task = instance_updater roles = RoleSet { roles: {} }
118652024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
118662024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = instance_updater resource = Database result = Ok(())
118672024-12-12T22:44:56.160ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
118682024-12-12T22:44:56.161ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_start elapsed = 56.093102ms iteration = 22 status = {"errors":[],"requests_created_ok":[],"start_invoked_ok":[]}
118692024-12-12T22:44:56.162ZINFOnexus (BackgroundTasks): listed instances with terminated active migrations background_task = instance_updater count = 0 file = nexus/src/app/background/tasks/instance_updater.rs:59
118702024-12-12T22:44:56.162ZINFOnexus (BackgroundTasks): instance updater activation completed background_task = instance_updater destroyed_active_vmms = 0 failed_active_vmms = 0 file = nexus/src/app/background/tasks/instance_updater.rs:225 terminated_active_migrations = 0 update_sagas_completed = 0 update_sagas_started = 0
118712024-12-12T22:44:56.162ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_updater elapsed = 57.316326ms iteration = 22 status = {"destroyed_active_vmms":0,"disabled":false,"failed_active_vmms":0,"query_errors":[],"saga_errors":[],"sagas_completed":0,"sagas_started":0,"terminated_active_migrations":0}
118722024-12-12T22:44:56.168ZINFOnexus (BackgroundTasks): all instance checks complete background_task = instance_watcher file = nexus/src/app/background/tasks/instance_watcher.rs:555 pruned_instances = 0 total_completed = 0 total_failed = 0 total_incomplete = 0 total_instances = 0 update_sagas_queued = 0
118732024-12-12T22:44:56.168ZDEBGnexus (BackgroundTasks): activation complete background_task = instance_watcher elapsed = 62.686801ms iteration = 22 status = {"failed_checks":{},"incomplete_checks":{},"instance_states":{},"pruned_instances":0,"total_instances":0,"update_sagas_queued":0}
118742024-12-12T22:44:56.185ZDEBGnexus (BackgroundTasks): activation complete background_task = region_replacement elapsed = 80.476071ms iteration = 22 status = {"errors":[],"requests_completed_ok":[],"requests_created_ok":[],"start_invoked_ok":[]}
118752024-12-12T22:44:56.185ZDEBGnexus (BackgroundTasks): roles background_task = region_snapshot_replacement_step roles = RoleSet { roles: {} }
118762024-12-12T22:44:56.186ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = region_snapshot_replacement_step resource = Database result = Ok(())
118772024-12-12T22:44:56.199ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118782024-12-12T22:44:56.199ZDEBGnexus (MgsClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118792024-12-12T22:44:56.199ZDEBGnexus (MgsClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "8891bd15-a7d5-4e86-a557-9de7c8638baf", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
118802024-12-12T22:44:56.199ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118812024-12-12T22:44:56.201ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = nat_v4_garbage_collector file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118822024-12-12T22:44:56.213ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
118832024-12-12T22:44:56.213ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
118842024-12-12T22:44:56.240ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1111 rack_id = ceaea472-35b2-490f-a91b-ab350691945c zone_address = fd00:1122:3344:101::2
118852024-12-12T22:44:56.240ZDEBGnexus (MgsClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118862024-12-12T22:44:56.240ZDEBGnexus (MgsClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1f6ca39-6bd5-45df-836f-0ea2a2db8c5a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:56 GMT"} })
118872024-12-12T22:44:56.240ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1116 rack_id = ceaea472-35b2-490f-a91b-ab350691945c slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118882024-12-12T22:44:56.242ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = switch_port_config_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n} rack_id = ceaea472-35b2-490f-a91b-ab350691945c
118892024-12-12T22:44:56.325ZDEBGnexus (DpdClient): client request background_task = nat_v4_garbage_collector body = None method = GET uri = http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen
118902024-12-12T22:44:56.325ZDEBGnexus (DpdClient): client response background_task = nat_v4_garbage_collector result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/rpw/nat/ipv4/gen", status: 200, headers: {"content-type": "application/json", "x-request-id": "e3289644-c9b7-4be4-9510-714e1afd6d1f", "content-length": "1", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
118912024-12-12T22:44:56.327ZDEBGnexus (BackgroundTasks): roles background_task = nat_v4_garbage_collector roles = RoleSet { roles: {} }
118922024-12-12T22:44:56.327ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = nat_v4_garbage_collector resource = Database result = Ok(())
118932024-12-12T22:44:56.330ZINFOnexus (BackgroundTasks): determining switch slot managed by dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1111 zone_address = fd00:1122:3344:101::2
118942024-12-12T22:44:56.330ZDEBGnexus (MgsClient): client request background_task = bfd_manager body = None method = GET uri = http://[fd00:1122:3344:101::2]:12225/local/switch-id
118952024-12-12T22:44:56.331ZDEBGnexus (MgsClient): client response background_task = bfd_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12225/local/switch-id", status: 200, headers: {"content-type": "application/json", "x-request-id": "c3f5c2c2-0085-4a35-a04c-125beae1e31a", "content-length": "26", "date": "Thu, 12 Dec 2024 22:44:56 GMT"} })
118962024-12-12T22:44:56.331ZINFOnexus (BackgroundTasks): identified switch slot for dendrite zone background_task = bfd_manager file = nexus/src/app/mod.rs:1116 slot = SpIdentifier {\n slot: 0,\n type_: Switch,\n} zone_address = fd00:1122:3344:101::2
118972024-12-12T22:44:56.332ZINFOnexus (BackgroundTasks): completed mapping dendrite zones to switch slots background_task = bfd_manager file = nexus/src/app/mod.rs:1148 mappings = {\n Switch0: fd00:1122:3344:101::2,\n}
118982024-12-12T22:44:56.346ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:98
118992024-12-12T22:44:56.346ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119002024-12-12T22:44:56.347ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 200, headers: {"content-type": "application/json", "x-request-id": "fed52d4c-d263-4576-96cd-149221a5d3b2", "content-length": "372", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119012024-12-12T22:44:56.347ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119022024-12-12T22:44:56.347ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119032024-12-12T22:44:56.348ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119042024-12-12T22:44:56.350ZDEBGnexus (BackgroundTasks): activation complete background_task = nat_v4_garbage_collector elapsed = 244.861769ms iteration = 22 status = null
119052024-12-12T22:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Read actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Sled { parent: Fleet, key: 4a8c9490-d35a-4221-8585-e4103b325118, lookup_type: ById(4a8c9490-d35a-4221-8585-e4103b325118) } result = Ok(())
119062024-12-12T22:44:56.351ZDEBGnexus (BackgroundTasks): roles background_task = service_zone_nat_tracker roles = RoleSet { roles: {} }
119072024-12-12T22:44:56.351ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = service_zone_nat_tracker resource = Database result = Ok(())
119082024-12-12T22:44:56.354ZDEBGnexus (BackgroundTasks): activation complete background_task = service_zone_nat_tracker elapsed = 248.625793ms iteration = 22 status = 0
119092024-12-12T22:44:56.377ZDEBGnexus (BackgroundTasks): activation complete background_task = region_snapshot_replacement_step elapsed = 271.995802ms iteration = 22 status = {"errors":[],"step_garbage_collect_invoked_ok":[],"step_invoked_ok":[],"step_records_created_ok":[]}
119102024-12-12T22:44:56.382ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119112024-12-12T22:44:56.383ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119122024-12-12T22:44:56.384ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119132024-12-12T22:44:56.386ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119142024-12-12T22:44:56.386ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119152024-12-12T22:44:56.386ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119162024-12-12T22:44:56.392ZINFOnexus (BackgroundTasks): computed internet gateway mappings for sled assocs = {} background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:116 sled = sock
119172024-12-12T22:44:56.392ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/eip-gateways
119182024-12-12T22:44:56.393ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/eip-gateways", status: 204, headers: {"x-request-id": "3ad1a2c8-ca15-4554-8284-2fa4735e10b1", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119192024-12-12T22:44:56.393ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119202024-12-12T22:44:56.393ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119212024-12-12T22:44:56.395ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119222024-12-12T22:44:56.395ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119232024-12-12T22:44:56.396ZDEBGnexus (BackgroundTasks): activation complete background_task = bfd_manager elapsed = 291.197939ms iteration = 22 status = {}
119242024-12-12T22:44:56.398ZDEBGnexus (BackgroundTasks): roles background_task = vpc_route_manager roles = RoleSet { roles: {} }
119252024-12-12T22:44:56.398ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = vpc_route_manager resource = Database result = Ok(())
119262024-12-12T22:44:56.402ZINFOnexus (BackgroundTasks): VPC route manager sled 4a8c9490-d35a-4221-8585-e4103b325118 push not needed background_task = vpc_route_manager file = nexus/src/app/background/tasks/vpc_routes.rs:262
119272024-12-12T22:44:56.402ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager body = Some(Body) method = PUT uri = http://[fd00:1122:3344:101::1]:12345/vpc-routes
119282024-12-12T22:44:56.402ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = vpc_route_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/vpc-routes", status: 204, headers: {"x-request-id": "ee31cca4-e9b4-4591-bfe8-83e7ad74fbda", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119292024-12-12T22:44:56.404ZDEBGnexus (BackgroundTasks): activation complete background_task = vpc_route_manager elapsed = 298.87252ms iteration = 23 status = {}
119302024-12-12T22:44:56.414ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {(Fleet, 001de000-1334-4000-8000-000000000000, "admin")} }
119312024-12-12T22:44:56.415ZDEBGnexus (BackgroundTasks): authorize result action = ListChildren actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Fleet result = Ok(())
119322024-12-12T22:44:56.415ZDEBGnexus (BackgroundTasks): roles background_task = v2p_manager roles = RoleSet { roles: {} }
119332024-12-12T22:44:56.415ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = v2p_manager resource = Database result = Ok(())
119342024-12-12T22:44:56.435ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119352024-12-12T22:44:56.435ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119362024-12-12T22:44:56.437ZINFOnexus (BackgroundTasks): fetching switch port settings background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:151 port = SwitchPort { id: 174d4dd3-4b26-4ef7-a56f-35a8bdaa31be, rack_id: ceaea472-35b2-490f-a91b-ab350691945c, switch_location: "switch0", port_name: "qsfp0", port_settings_id: Some(dfcd867b-8114-4b46-bc2c-80451afac2ab) } rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
119372024-12-12T22:44:56.437ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119382024-12-12T22:44:56.437ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119392024-12-12T22:44:56.446ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron
119402024-12-12T22:44:56.446ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/port/qsfp0/settings?tag=omicron", status: 200, headers: {"content-type": "application/json", "x-request-id": "981e35eb-28e1-4fc7-9f37-13d5ae6ac420", "content-length": "134", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119412024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): retrieved port settings from switch background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1746 rack_id = ceaea472-35b2-490f-a91b-ab350691945c settings = PortSettings { links: {"0": LinkSettings { addrs: [10.151.2.174], params: LinkCreate { autoneg: false, fec: Some(None), kr: false, lane: Some(LinkId(0)), speed: Speed40G, tx_eq: None } }} } switch_port_id = "qsfp0"
119422024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): port settings up to date, skipping background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1773 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0 switch_port_id = "qsfp0" switch_port_settings_id = dfcd867b-8114-4b46-bc2c-80451afac2ab
119432024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): retrieved existing routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:383 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, Some(1))}}
119442024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): retrieved desired routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:387 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: {(10.151.2.100, Prefix4 { length: 0, value: 0.0.0.0 }, None, None)}}
119452024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): calculated static routes to add background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:396 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119462024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): calculated static routes to delete background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:402 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119472024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): deleting static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:407 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119482024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): removing static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1920 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = DeleteStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119492024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): adding static routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:413 rack_id = ceaea472-35b2-490f-a91b-ab350691945c routes = {Switch0: AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } }}
119502024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): adding static v4 routes background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:1956 rack_id = ceaea472-35b2-490f-a91b-ab350691945c request = AddStaticRoute4Request { routes: StaticRoute4List { list: [StaticRoute4 { nexthop: 10.151.2.100, prefix: Prefix4 { length: 0, value: 0.0.0.0 }, rib_priority: 1, vlan_id: None }] } } switch_location = Switch0
119512024-12-12T22:44:56.447ZINFOnexus (BackgroundTasks): checking for changes to loopback addresses background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:422 rack_id = ceaea472-35b2-490f-a91b-ab350691945c
119522024-12-12T22:44:56.447ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119532024-12-12T22:44:56.447ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119542024-12-12T22:44:56.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv4
119552024-12-12T22:44:56.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv4", status: 200, headers: {"content-type": "application/json", "x-request-id": "d1498c91-c383-4f3c-9d81-e6eb9a2968df", "content-length": "2", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119562024-12-12T22:44:56.449ZDEBGnexus (DpdClient): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::2]:12224/loopback/ipv6
119572024-12-12T22:44:56.449ZDEBGnexus (DpdClient): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::2]:12224/loopback/ipv6", status: 200, headers: {"content-type": "application/json", "x-request-id": "aaf347b2-af30-43ca-9c4c-0ad4eb23ee5a", "content-length": "52", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119582024-12-12T22:44:56.449ZINFOnexus (BackgroundTasks): applying SMF config uplink updates to switch zone background_task = switch_port_config_manager config = [HostPortConfig { addrs: [UplinkAddressConfig { address: V4(Ipv4Net { addr: 10.151.2.174, width: 24 }), vlan_id: None }], lldp: Some(LldpPortConfig { chassis_id: None, management_addrs: None, port_description: None, port_id: None, status: Disabled, system_description: None, system_name: None }), port: "qsfp0", tx_eq: None }] file = nexus/src/app/background/tasks/sync_switch_configuration.rs:471 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch_location = Switch0
119592024-12-12T22:44:56.449ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = Some(Body) method = POST rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/switch-ports
119602024-12-12T22:44:56.501ZDEBGnexus (BackgroundTasks): client request SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager body = None method = GET uri = http://[fd00:1122:3344:101::1]:12345/v2p
119612024-12-12T22:44:56.546ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/switch-ports", status: 204, headers: {"x-request-id": "83f252d0-73ed-4de5-9289-2ef00f5e2e7c", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119622024-12-12T22:44:56.546ZINFOnexus (BackgroundTasks): no bgp config found for switch, skipping. background_task = switch_port_config_manager file = nexus/src/app/background/tasks/sync_switch_configuration.rs:774 rack_id = ceaea472-35b2-490f-a91b-ab350691945c switch = Switch0
119632024-12-12T22:44:56.546ZDEBGnexus (BackgroundTasks): client request background_task = switch_port_config_manager body = None method = GET rack_id = ceaea472-35b2-490f-a91b-ab350691945c uri = http://[fd00:1122:3344:101::1]:12345/network-bootstore-config
119642024-12-12T22:44:56.547ZDEBGnexus (BackgroundTasks): client response background_task = switch_port_config_manager rack_id = ceaea472-35b2-490f-a91b-ab350691945c result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/network-bootstore-config", status: 200, headers: {"content-type": "application/json", "x-request-id": "bb89bce9-1b05-43ee-9dbb-636d962f57ae", "content-length": "682", "date": "Thu, 12 Dec 2024 22:44:56 GMT"} })
119652024-12-12T22:44:56.547ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119662024-12-12T22:44:56.547ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119672024-12-12T22:44:56.547ZDEBGnexus (BackgroundTasks): client response SledAgent = 4a8c9490-d35a-4221-8585-e4103b325118 background_task = v2p_manager result = Ok(Response { url: "http://[fd00:1122:3344:101::1]:12345/v2p", status: 200, headers: {"content-type": "application/json", "x-request-id": "2e9d702f-1a38-4200-9958-1b955704ba43", "content-length": "691", "date": "Thu, 12 Dec 2024 22:44:55 GMT"} })
119682024-12-12T22:44:56.547ZINFOnexus (BackgroundTasks): found opte v2p mappings background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:102 interfaces = {} sled = sock
119692024-12-12T22:44:56.547ZINFOnexus (BackgroundTasks): v2p mappings to delete background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:114 mappings = [] sled = sock
119702024-12-12T22:44:56.547ZINFOnexus (BackgroundTasks): v2p mappings to add background_task = v2p_manager file = nexus/src/app/background/tasks/v2p_mappings.rs:127 mappings = [] sled = sock
119712024-12-12T22:44:56.548ZDEBGnexus (BackgroundTasks): activation complete background_task = v2p_manager elapsed = 443.49875ms iteration = 22 status = {}
119722024-12-12T22:44:56.550ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119732024-12-12T22:44:56.551ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119742024-12-12T22:44:56.554ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119752024-12-12T22:44:56.554ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119762024-12-12T22:44:56.556ZDEBGnexus (BackgroundTasks): roles background_task = switch_port_config_manager roles = RoleSet { roles: {} }
119772024-12-12T22:44:56.556ZDEBGnexus (BackgroundTasks): authorize result action = Query actor = Some(Actor::UserBuiltin { user_builtin_id: 001de000-05e4-4000-8000-000000000002, .. }) background_task = switch_port_config_manager resource = Database result = Ok(())
119782024-12-12T22:44:56.563ZDEBGnexus (BackgroundTasks): activation complete background_task = switch_port_config_manager elapsed = 458.533435ms iteration = 22 status = {}
119792024-12-12T22:44:57.189ZINFOnexus (dropshot): request completed file = /home/build/.cargo/registry/src/index.crates.io-6f17d22bba15001f/dropshot-0.13.0/src/server.rs:863 latency_us = 1057 local_addr = [fd00:1122:3344:101::c]:43664 method = GET remote_addr = [fd00:1122:3344:101::d]:42878 req_id = a671cece-84bb-4581-aa45-f5da4784e10e response_code = 200 uri = /736f44c0-88a6-4603-9cb4-5b66735cd20b